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(54) Motion vector detecting, picture encoding and recording method and apparatus 



(57) A moving vector calculating method is dis- 
closed, that comprises the steps of (a) extracting a block 
from a reference picture corresponding to a block of a 
current picture to be processed, the size of the block of 
the reference picture being the same as the size of the 
block of the current picture, the origin of the block of the 
reference picture matching the origin of the block of the 
current picture, (b) while moving the block of the refer- 
ence picture in a predetermined search area, obtaining 
a residual between the block of the current picture and 
the block of the reference picture, (c) detecting a block 
with the minimum residual from the reference picture so 
as to calculate a moving vector, (d) orthogonally trans- 
forming pixel data of a block of the reference picture and 
pixel data of a block of the current picture, and (e) 
obtaining a residual between orthogonally transformed 
data of the block of the reference picture and orthogo- 
nally transformed data of each block of the current pic- 
ture. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

[0001 ] The present invention relates to a moving vec- 
tor calculating method suitable for performing an encod- 
ing process corresponding to for exarrple MPEG 
(Moving Picture Experts Group) 2 method by software 10 
process. The present invention also relates to a record 
medium on which a moving vector calculating program 
has been recorded. 

Description of the Related Art 15 

[0002] As a highly efficient compressing method for a 
picture, MPEG2 method has become common. In the 
MPEG2 method, a video signal is compressed and 
encoded by a motion compensation predictive encoding 20 
method and DCT (Discrete Cosine Transform) method. 
[0003] In the MPEG2 method, three types of pictures 
that are an I (Intra) picture, a P (Predictive) picture, and 
a B ( Bidirectional Predictive) picture are transmitted. 
For an I picture. DCT encoding process is performed 25 
with pixels of the same frame. For a P picture, with ref- 
erence to an I picture or a P picture that has been 
encoded, DCT encoding process is performed using 
motion compensation predicting process. For a B pic- 
ture, with reference to I pictures or P pictures that pre- 30 
cede and follow the B picture, DCT encoding process is 
performed using motion predicting process. 
[0004] For a P picture or a B picture, an intra-encoding 
process may be performed for each macro block. In 
other words, when a picture contains many DC compo- 35 
nents, the picture can be effectively compressed by the 
intra-encoding process. Thus, in this case, the intra- 
encoding process is performed. 
[0005] Fig. 1 is a block diagram showing an example 
of the structure of a conventional MPEG2 encoder. 40 
Referring to Fig. 1, a component digital video signal is 
supplied to an input terminal 101. The component dig- 
ital video signal is composed of a luminance signal Y 
and color difference signals Cb and Cr The digital video 
signal is supplied from the input terminal 1 01 to a frame 45 
memory 102 through a moving vector detecting circuit 
1 03. The frame memory 1 02 temporarily stores the dig- 
ital video signal. The frame memory 102 has a storage 
capacity for at least three frames of pictures of a current 
picture, a past reference picture, and a future reference so 
picture. 

[0006] The moving vector detecting circuit 1 03 obtains 
a moving vector between a reference picture and a cur- 
rent picture using data stored in the frame memory 102. 
A moving vector MV is obtained for each macro-block 55 
Each macro-block is composed of for exarrple (16x16) 
pixels. The obtained moving vector MV is supplied to a 
variable length code encoding circuit 108 and a motion 



compensating circuit 115. The motion vector detecting 
circuit 103 supplies residual information e to a mode 
setting circuit 104. The residual information e is 
obtained along with the moving vector MV by the mov- 
ing vector detecting circuit 1 03. 
[0007] An output signal of the frame memory 102 is 
supplied to a terminal 105A of a switch circuit 105 
through the moving vector detecting circuit 1 03. In addi- 
tion, the output signal of the frame memory 102 is sup- 
plied to a subtracting circuit 106 and a subtracting circuit 
107. An output signal of the subtracting circuit 106 is 
supplied to a terminal 105B of the switch circuit 105. An 
output signal of the subtracting circuit 107 is supplied to 
a terminal 105C of the switch circuit 105. 
[0008] The switch circuit 105 changes an encoding 
mode corresponding to a mode set signal received from 
the mode setting circuit 104. In other words, in intra- 
frame encoding mode, the switch circuit 105 selects the 
terminal 1 05 A. In the forward predictive encoding mode, 
the switch circuit 105 selects the terminal 105B. In the 
bidirectionally predictive encoding mode, the switch cir- 
cuit 105 selects the terminal 105C. 
[0009] When an I picture is transmitted, the intra- 
frame predictive encoding process is performed. At this 
point, the switch circuit 105 selects the terminal 105A. 
The frame memory 102 outputs picture data of the cur- 
rent frame. The picture data of the cunent frame is sup- 
plied to a DCT circuit 1 06 through the switch circuit 105. 
[0010] For example, the DCT circuit 106 transforms a 
video signal of each bkxk of (8 x 8) pixels in a time 
region into spectrum data in a frequency region. The 
spectrum data is zigzag-scanned and read from lower 
frequency components to higher frequency components 
(namely, from DC components). An output signal of the 
DCT circuit 106 is supplied to a quantizing circuit 107. 
[001 1 ] A quantizing scale is set to the quantizing cir- 
cuit 107 corresponding to information of an output bit 
rate received from a transmission buffer 109. The quan- 
tizing circuit 1 07 quantizes spectrum data received from 
the DCT circuit 106 corresponding to the quantizing 
scale. Thus, the bit rate of the output bit stream is kept 
constant 

[001 2] An output signal of the quantizing circuit 1 07 is 
supplied to both the variable length code encoding cir- 
cuit 108 and an inversely quantizing circuit 110. The 
variable length code encoding circuit 108 encodes the 
spectrum data (received from the quantizing circuit 
107), the moving vector, the quantizing scale, and the 
prediction mode with variable length code. 
[001 3] The variable length code encoding circuit 1 08 
outputs an encoded bit stream. The encoded bit stream 
is temporarily stored to the transmission buffer 109. A 
data stream is read from the transmission buffer 109 
corresponding to a required bit rate. 
[0014] As descrfoed above, the output signal of the 
quantizing circuit 1 07 is supplied to the inversely quan- 
tizing circuit 1 10. An output signal of the inversely quan- 
tizing circuit 110 is supplied to an IDCT circuit 112. In 
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the case of an I picture, the DCT process is performed 
with pixels of the same frame. Thus, the inversely quan- 
tizing circuit 1 10 and the IDCT circuit 1 1 2 form the orig- 
inal picture. Digital video data for one picture is supplied 
to a picture frame memory 1 1 4 through an adding circuit 5 
1 13. Data stored in the frame memory 114 is used tor 
data of a reference frame of the next P picture or B pic- 
ture. 

[0015] When a P picture is transmitted, a forward pre- 
dictive encoding process is performed with a reference w 
frame. At this point, the switch circuit 1 05 selects the ter- 
minal 105R The frame memory 102 outputs a digital 
video signal of the current frame. An output signal of the 
frame memory 102 is supplied to the subtracting circuit 
108. , 5 
[0016] The frame memory 1 14 stores data of a refer- 
ence frame. The motion compensating circuit 1 1 5 com- 
pensates the motion of the data of the reference frame 
and supplies the resultant data to the subtracting circuit 
106. The subtracting circuit 106 obtains the difference 20 
between data of the current frame and data of the refer- 
ence frame that has been motion-compensated. The 
difference data is suppfied to the DCT circuit 106 
through the switch circuit 105. 

[0017] The DCT circuit 106 performs the DCT process 25 
tor the difference data. Namely, the DCT circuit 106 
transforms the difference data into spectrum data. An 
output signal of the DCT circuit 106 is suppfied to the 
quantizing circuit 107. The quantizing circuit 107 quan- 
tizes the spectrum data received from the DCT circuit 30 
106. 

[0018] An output signal of the quantizing circuit 107 is 
supplied to both the variable length code encoding cir- 
cuit 108 and the inversely quantizing circuit 110. The 
variable length code encoding circuit 108 encodes the 35 
spectrum data (received from the quantizing circuit 
107). the moving vector, the quantizing scale, and the 
prediction mode with variable length code. 
[001 9] The variable length code encoding circuit 1 08 
outputs an encoded bit stream. The encoded bit stream 40 
is temporarily stored in the transmission buffer 109. A 
data stream is read from the transmission buffer 109 
corresponding to a required bit rate. The data stream is 
obtained from an output terminal 111. 
[0020] An output signal of the quantizing circuit 107 is 45 
supplied to the inversely quantizing circuit 1 10. An out- 
put signal of the inversely quantizing circuit 1 10 is sup- 
plied to the IDCT circuit 1 12. In the case of a P picture, 
the DCT process is performed for the difference 
between data of a reference frame and data of the cur- so 
rent picture. Thus, the quantizing circuit 110 and the 
IDCT circuit 1 12 obtain the cfifference between data of 
the reference frame and data of the current picture. The 
difference data is supplied to the adding circuit 1 13. 
[0021] The frame memory 1 14 supplies data of a ret- 55 
erence picture to the adding circuit 1 13 through the 
motion compensating circuit 1 15. The adding circuit 113 
adds the difference data to the data of the reference pic- 



ture. An output signal of the adding circuit 1 13 is stored 
as data of the next reference frame to the frame mem- 
ory 114. 

[0022] When a Bpicture is transmitted, with a past ref- 
erence frame and a future reference frame, bidirection- 
ally predictive encoding process is performed, to this 
case, the switch circuit 105 selects the terminal 105C. 
The frame memory 102 outputs a cf grtaJ video signal of 
the current frame. The output signal of the frame mem- 
ory 102 is supplied to the subtracting circuit 107. 
[0023] The frame memory 114 stores data of a past 
reference frame and data of a future reference frame. 
The motion compensating circuit 115 motion-compen- 
sates the data of both the reference frames. An output 
signal of the motion compensating circuit 1 15 is sup- 
plied to the subtracting circuit 107. The subtracting cir- 
cuit 107 obtains the cfifference among the data of the 
current frame, the data of the past reference frame, and 
the data of the future reference frame that have been 
motion-compensated. The difference data is supplied to 
the DCT circuit 106 through the switch circuit 105. 
[0024] The DCT circuit 106 performs the DCT process 
for the difference data. In other words, the DCT circuit 
106 transforms the difference data into spectrum data. 
An output signal of the DCT circuit 106 is supplied to the 
quantizing circuit 107. The quantizing circuit 107 quan- 
tizes the spectrum data received from the DCT circuit 
106. 

[0025] An output signal of the quantizing circuit 1 07 is 
suppfied to both the variable length code encoding cir- 
cuit 108 and the inversely quantizing circuit 110. The 
variable length code encoding circuit 108 encodes the 
spectrum data (received from the quantizing circuit 
107), the moving vector, the quantizing scale, and the 
prediction mode with variable length code. 
[0026] The variable length code encoding circuit 1 08 
outputs an encoded bit stream. The bit stream is tempo- 
rally stored to the transmission buffer 109. The trans- 
mission buffer 109 reads data stream corresponding to 
a required bit rate. The data stream is obtained from the 
output terminal 111. 

[0027] In recent years, since the process speeds of 
CPUs (Central Processing Units) are becoming very 
fast and memories with large storage capacity are 
becoming inexpensive, the abcve-descrfeed MPEG2 
encoder can be performed by software. 
[0028] However, in the MPEG2 encoding process, a 
process for calculating a moving vector is required- A 
moving vector is obtained by a block matching process. 
In other words, a block with the same size and the same 
origin as a block divided from the current frame to be 
processed is extracted from a reference frame. While 
the block of the reference frame is being moved in a pre- 
determined search area, the sum of the absolute values 
of the difference values between pixels of the block of 
the reference frame and pixels of the relevant block of 
the current frame is obtained as a residual. A block of 
the reference frame with the minimum residual is 
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obtained. Since the block matching process requires 
many calculating steps, it is difficult to perform the 
MPEG2 encoding process by software. 
[0029] In other words, when the moving vector of a 
block CBLK of a current frame 401 shown in Fig. 2 is 
obtained, a search area SA is defined on the periphery 
of a block RBLK of the reference frame 402 correspond- 
ing to the block CBLK as an origin. The block RBLK of 
the reference frame is extracted from the search area 
SA. The difference values between (16 x 16) pixels of 
the reference block RBLK and (16 x 16) pixels of the 
current block CBLK are obtained The sum of the abso- 
lute values of the difference values is obtained as a 
residual. The block RBLK of the reference frame 402 is 
moved in the predetermined search area SA. At each 
position of the block RBLK in the search area SA, the 
difference values between pixels of the block RBLK and 
pixels of the block CBLK of the current frame 401 are 
obtained. The sum of the absolute values of the differ- 
ence values is obtained as a residual. The obtained 
sums are compared. A block with the minimum residual 
is treated as a matched block. With the matched block, 
a moving vector is obtained. 

[0030] To detect a rnoving vector by the block match- 
ing process, when each block is composed of (16 x 16) 
pixels, to obtain difference values of pixels, 16 x 16 = 
256 subtracting operations are required. To obtain the 
sum of the absolute values of the difference values. 256 
adding operations are required. 
[0031 ] When a moving vector is detected by moving a 
reference block in a predetermined search area at one 
pixel step, residuals should be obtained a number of 
times corresponding to the number of pixels in the 
search area. Thus, when residuals are obtained by 
moving a block in a predetermined search area at one 
pixel step and a moving vector is detected with the posi- 
tion of a block with the minimum residual, the number of 
calculating steps becomes huge. Thus, it is difficult to 
perform the MPEG2 encoding process by software. 
[0032] To search a moving vector at high speed, two 
approaches can be considered. As the first approach, 
whenever the block matching process is performed, the 
number of calculating steps is decreased. As the sec- 
ond approach, the number of times of the block match- 
ing process in a search area is decreased. 
[0033] As an example of the first approach, while the 
sum of the absolute values of the difference values 
between pixels of a block of the reference frame and 
pixels of the relevant block of the current frame is being 
calculated, the sum is compared with a predetermined 
threshold value Then the sum is larger than the prede- 
termined threshold value, the process is terminated. 
[0034] Since a moving vector is obtained by obtaining 
the minimum value of the sum of the absolute values of 
the difference values between pixels of a block of the 
reference frame and pixels of the relevant block of the 
current frame. Thus, when the sum exceeds the prede- 
termined threshold value, the sum does not become the 



minimum value. Thus, it is meaningless to continue the 
process. Consequently, when the sum is larger than the 
predetermined threshold value, the process is termi- 
nated. As a result, the number of calculating steps can 
s be decreased and a moving vector can be detected at 
high speed. 

[0035] However, in this case, it is dHficutt to assign 
such a threshold value. Then the threshold value is too 
small, the process is terminated at all points. Thus, a 
10 moving vector cannot be correctly detected. In contrast, 
when the threshold value is too large, since the process 
is not terminated, the efficiency of the process cannot 
be improved. 

[0036] To decrease the number of calculating steps for 

is the block matching process, a method for thinning out 
pixels of a reference frame and pixels of a current frame 
checkerwise. In this case, the number of calculating 
steps for calculating the sum of the absolute values of 
the difference values can be halved. 

20 [0037] However, when blocks are thinned out check- 
erwise. since the continuity of data of pixels is lost, an 
MMX instruction cannot be used. Since an MMX 
instruction allows a plurality of successive data pieces 
to be processed at a time, recent personal computers 

25 are equipped with CPUs that handle an MMX function. 
Since the block matching process obtains the sum of 
the absolute values of the difference values between 
pixels, with an MMX instruction, the block matching 
process can be performed at high speed. However, 

30 when pixels of blocks are thinned out checkerwise, 
since the continuity of data of pixels is lost, an MMX 
instruction cannot be used. Thus, even rf pixels of blocks 
are thinned out checkerwise and thereby the number of 
times of the block matching process is decreased, the 

35 process time cannot be remarkably shortened. As a 
conventional moving picture encoding apparatus that 
encodes picture data of a moving picture, a hybrid 
encoding process that is a combination of motion com- 
pensated inter-frame predicting process and DCT (Dis- 

40 crete Cosine Transform) process is performed for each 
block of (8 x 8) pixels. 

[0038] The moving picture encoding apparatus 
detects a moving vector between adjacent frames and 
motion-compensates the moving picture with the 
45 detected moving vector so as to decrease the amount of 
encoded data. 

[0039] Conventional moving picture encoding appara- 
tuses detect the motion of a picture in various methods. 
When the motion of a picture is detected, macro blocks 

so at a relevant position of adjacent frames are sometimes 
compared. When the macro blocks are compared, the 
moving cfirection of the picture is unknown. Thus, the 
predetermined area around the relevant position of the 
adjacent frames is searched for macro blocks with a 

ss small difference of luminance values. 

[0040] When a camera that photoc/aphs a moving 
picture is fixed at a predetermined position and an 
object is being moved, the moving direction of the object 
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varies at each position of the entire picture. Thus, macro 
blocks around a start point are searched. When the 
motion of the object is large, it may deviate from the 
search area In this case, the intra-frame encoding proc- 
ess is performed instead of the inter-frame encoding 
process. 

[0041] In a conventional moving picture encoding 
apparatus, a hierarchical searching method has been 
proposed so as to decrease the number of calculating 
steps for detecting the motion of a picture. In this 
method, the motion of a picture is detected so that one 
moving vector is detected with a plurality of macro 
blocks. To obtain a moving vector of each macro block, 
the moving vector tor the plurality of macro blocks is 
used. 

[0042] However, in such a moving picture encoding 
apparatus, macro blocks are searched in a predeter- 
mined area so as to detect macro blocks whose differ- 
ence is small. Thus, when an object that largely moves 
is processed, it is necessary to widen the search area. 
Therefore, the process time necessary for detecting the 
motion of a picture exponentially increases. 
[0043] In the moving picture encoring apparatus, 
when the motion of an object is large, the intra-frame 
encoring process (for macro blocks of the same frame) 
is performed instead of the inter-frame encoding proc- 
ess (for macro blocks of a plurality of frames). In this 
case, when the motion of a photographed picture 
exceeds a predetermined search area, if the intra-frame 
encoring process is performed for all macro blocks, the 
number of calculating steps increases. Thus, the load of 
the apparatus becomes large. This situation takes place 
in the case that when an object is panned if the entire 
picture moves in excess of the search area 
[0044] In a moving picture encoring apparatus that 
obtains moving vectors of a plurality of macro blocks, 
when the picture largely moves in excess of the screen, 
a moving vector cannot be detected. Thus, moving vec- 
tors of a plurality of macro blocks cannot be detected. 
[0045] Rg. 3 shows an example of the structure of a 
conventional moving picture encoding apparatus that 
encodes picture data of a moving picture by a hybrid 
encoring process that is a combination of a motion 
compensation inter-frame predicting process and a 
DCT (Discrete Cosine Transform) process. 
[0046] In Rg. 3. an input MB (Macro Block) signal S1 1 
is supplied to a terminal 501. A moving vector signal MV 
is supplied as macro blocks MB one by one to a terminal 
502. The input MB signal S51 1 and the moving vector 
signal MV are supplied to a motion compensating circuit 
503. 

[0047] The motion compensating circuit 503 has an 
internal picture memory. A predictive picture signal 
(hereinafter referred to as predictive MB signal) is read 
as macro blocks MB one by one from the picture mem- ; 
ory corresponding to the moving vector signal MV. The 
motion compensating circuit 503 outputs a signal S512 
that is the prerictive MB signal obtained from the motion 



vector signal MV 

[0048] A calculating device 504 adds the input MB sig- 
nal S511 that is an addition signal and the signal S512 
that is a subtraction signal as macro blocks MB one by 
one. Thus, the calculating device 504 calculates the dif- 
ference between the input MB signal and the signal 
S51 2 and outputs the difference as a predictive residual 
MB signal S51 3. 

[0049] The predictive residual MB signal S513 is sup- 
plied to a DCT droit 505. The DCT circuit 505 performs 
a two-dimensional DCT process for each block of (8 x 8) 
pixels of the predictive residual MB signal S51 3 and out- 
puts a DCT coefficient. The DCT coefficient is supplied 
to a quantizing circuit 506. 
is [0050] The quantizing circuit 506 quantizes the DCT 
coefficient corresponding to a quantizing scale mQ 
received from a terminal 507. the difference of the abso- 
lute value of the predictive MB signal received from the 
motion compensating circuit 503. and the difference 
20 between the absolute value and the mean value and 
outputs the resultant signal as a quantized signal. 
[0051 ] The quantized signal received from the quan- 
tizing circuit 506 and a moving vector MV corresponding 
thereto are supplied to a variable length code encoding 
25 (VLC) circuit 508. The variable length code encoding 
circuit 508 encodes the quantized signal and the mov- 
ing vector MV with variable length code corresponding 
to MPEG syntax. 

[0052] An output signal of the variable length code 
30 encoding ctrcuit 508 is supplied to a buffer memory509. 
The buffer memory 509 smooths the fluctuation of the 
number of bits of data that is generated in a short time 
period and received from the variable length code 
encoding circuit 508 and outputs an encoded bit stream 
35 at a desired bit rate. The encoded bit stream that is 
received from the buffer memory 509 is output from a 
terminal 510. 

[0053] The quantized signal and the quantizing scale 
received from the quantizing circuit 506 are supplied to 
40 an inversely quantizing circuit 51 1 . The inversely quan- 
tizing circuit 51 1 inversely quantizes the quantized sig- 
nal corresponding to the quantizing scale. An output 
signal of the inversely quantizing circuit 51 1 is supplied 
to an inversely DCT circuit 512. The inversely DCT ar- 
ts cuit 512 performs an inversely DCT process for the sig- 
nal received from the inversely quantizing circuit 51 1 
and outputs the resultant signal as a predictive residual 
MB signal S515 to a calculating device 513. 
[0054] The calculating device 513 also receives the 
so predictive MB signal S512 that is supplied to the calcu- 
lating device 504. The calculating device 513 adds the 
predictive residual MB signal S515 and the predictive 
MB signal S512 and outputs a locally decoded picture 
signal. This picture signal is the same as an output sig- 
55 nal of the receiver side (decoder side). 

[0055] The conventional moving picture encoding 
apparatus performs the DCT process and the quantiz- 
ing process for an pictures received from the terminal 
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501. The moving picture encoding apparatus deter- 
mines whether or not the DCT coefficient of each macro 
block of the picture to be encoded is present after per- 
forming the DCT process and the quantizing process for 
the picture data and completing all calculating steps for 
the DCT coefficient 

[0056] However, since the moving picture encoding 
apparatus performs the calculating steps for all macro 
blocks even if their DCT coefficients finally become "0", 
unnecessary calculating steps should be performed. 
[0057] In addition, since the conventional moving pic- 
ture encoding apparatus determine whether or not all 
DCT coefficients of macro blocks are "0" only after per- 
forming aO calculating steps, all the calculating steps 
should be performed. 



OBJECTS AND SUMMARY OF THE INVENTION 

[0058] The present invention is made from the above- 
described point of view. 

[0059] A first object of the present invention is to 
decrease the number of calculating steps of the block 
matching process for detecting a moving vector and to 
detect it at high speed. 

[0060] A second object of the present invention is to 
provide a moving vector calculating method and a 
record medium on which a program thereof has been 
recorded, the moving vector calculating method allow- 
ing the number of times of the block matching process in 
a predetermined search area to be decreased so as to 
increase the process speed and an MMX instruction to 
be effectively used. 

[0061] A third object of the present invention is to pro- 
vide a motion detecting apparatus and a motion detect- 
ing method that allow a moving vector of a picture that 
largely moves on the entire screen to be detected. 
[0062] A fourth object of the present invention is to 
provide a picture encoring apparatus and a picture 
encodng method that allow a time period of an encod- 
ing process for a picture whose DCT coefficient finally 
becomes "0" to be shortened. 
[0063] A first aspect of the present invention is a mov- 
ing vector calculating method, comprising the steps of 
(a) extracting a block from a reference picture corre- 
spond ng to a Wck^ of a oinert picture to be processed, 
the size of the block of the reference picture being the 
same as the size of the block of the current picture, the 
origin of the block of the reference picture matching the 
origin of the block of the current picture, (b) while mov- 
ing the block of the reference picture in a predetermined 
search area, obtaining a residual between the block of 
the current picture and the block of the reference pic- 
ture, (c) detecting a block with the minimum residual 
from the reference picture so as to calculate a moving 
vector, (d) orthogonally transforming pixel data of a 
block of the reference picture and pixel data of a block of 
the current picture, and (e) obtaining a residual between 
orthogonally transformed data of the block of the refer- 



ence picture and orthogonally transformed data of each 
block of the current picture. 

[0064] A second aspect of the present invention is a 
record medium on which a moving vector calculating 
5 program has been recorded, the moving vector calculat- 
ing program causing a system that has the record 
medium to perform the steps of (a) extracting a block 
from a reference picture corresponding to a block of a 
current picture to be processed, the size of the block of 
w the reference picture being the same as the size of the 
block of the current picture, the origin of the block of the 
reference picture matching the origin of the block of the 
current picture, (b) while moving the block of the refer- 
ence picture in a predetermined search area, obtaining 
is a residual between the block of the current picture and 
the block of the reference picture, (c) detecting a block 
with the minimum residual from the reference picture so 
as to calculate a moving vector, (d) orthogonally trans- 
forming pixel data of a block of the reference picture and 
20 pixel data of a block of the current picture, and (e) 
obtaining a residual between orthogonally transformed 
data of the block of the reference picture and orthogo- 
nally transformed data of each block of the cunent pic- 
ture. 

25 [0065] A third aspect of the present invention is a mov- 
ing vector calculating method, comprising the steps of 
(a) extracting a block from a reference picture corre- 
sponding to a block of a current picture to be processed, 
the size of the block o* the reference picture being the 
30 same as the size of the block of the current picture, the 
origin of the block of the reference picture matching the 
origin of the block of the current picture, (b) while mov- 
ing the block of the reference picture in a predetermined 
search area, obtaining a residual between the block of 
35 the current picture and the block of the reference pic- 
ture, (c) detecting a block with the rrtnimum residual 
from the reference picture so as to calculate a moving 
vector, (d) while calculating a residual between pixels of 
a block of the reference picture and pixels of a block of 
40 the current picture, comparing the obtained residual 
with a predetermined threshold value, and (e) when the 
residual is larger than the predetermined threshold 
value, stopping the calculation of the moving vector, and 
(f) setting the initial value of the predetermined thresh- 
45 old value corresponding to a characteristic of a picture. 
[0066] A forth aspect of the present invention is a 
record medium on which a moving vector calculating 
program has been recorded, the moving vector calculat- 
ing program causing a system that has the record 
so medium to perform the steps of (a) extracting a block 
from a reference picture corresponding to a block of a 
current picture to be processed, the size of the block of 
the reference picture being the same as the size of the 
block of the current picture, the origin of the block of the 
ss reference picture matching the origin of the block of the 
current picture, (b) while moving the block of the refer- 
ence picture in a predetermined search area, obtaining 
a residual between the block of the current picture and 
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the block of the reference picture, (c) detecting a block 
with the minimum residual from the reference picture so 
as to calculate a moving vector, (d) while calculating a 
residual between pixels of a block of the reference pic- 
ture and pixels of a block of the current picture, compar- 
ing the obtained residual with a predetermined 
threshold value, and (e) when the residual is larger than 
the predetermined threshold value, stopping the calcu- 
lation of the moving vector, and (f) setting the initial 
value of the predetermined threshold value correspond- 
ing to a characteristic of a picture. 
[0067] A fifth aspect of the present invention is a 
motion detecting apparatus, comprising an extracting 
means for extracting a plurality of macro blocks from a 
picture, a first motion detecting means for detecting a 
moving vector of each of the plurality of macro blocks 
extracted by the extracting means, a motion calculating 
means for calculating a moving vector of the entire pic- 
ture with moving vectors of individual macro blocks 
detected by the first motion detecting means, and a sec- 
ond motion detecting means for calculating a moving 
vector of each macro block with the moving vector cal- 
culated by the motion calculating means. 
[0068] A sixth aspect of the present invention is a 
motion detecting method, comprising the steps of (a) 
extracting a plurality of macro blocks from a picture, (b) 
detecting a moving vector of each of the plurality of 
macro blocks that have been extracted, (c) calculating a 
moving vector of the entire picture with moving vectors 
of individual macro blocks that have been detected, and 
(d) calculating a rncvirxj vector of each macro block with 
the moving vector that have been calculated. 
[0069] A seventh aspect of the present invention is a 
picture encoding apparatus, comprising a motion 
detecting means for detecting a moving vector of a pre- 
determined pixel block of input picture data and gener- 
ating motion residual information, a determining means 
for comparing the motion residual information received 
from the motion detecting means with a predetermined 
value and generating a determined result, a picture data 
process means for performing a predetermined process 
for picture data the predetermined process being 
required for an encoding process, an encoding means 
for performing the encoring process for picture data, 
and a controlling means for slapping the predetermined 
process performed by the picture data process means 
corresponding to the determined result of the determin- 
ing means and causing the encoding means to perform 
the encoding process. 

[0070] An eighth aspect of the present invention is a 
picture encoding method, comprising the steps of (a) 
detecting a moving vector of a predetermined pixel 
block of input picture data and generating motion resid- 
ual information, (b) comparing the motion residual infor- 
mation with a predetermined value and generating a 
determined result, (c) performing a predetermined proc- 
ess for picture data, the predetermined process being 
required for an encoding process, and (d) skipping the 



predetermined process corresponding to the deter- 
mined result and performing the encoding process for 
the picture data. 

[0071] A ninth aspect of the present invention is a 
s moving vector calculating method, comprising the steps 
of (a) extracting a block from a reference picture corre- 
sponding to a block of a current picture to be processed, 
the size of the block of the reference picture being the 
same as the size of the block of the current picture, the 
10 origin of the block of the reference picture matching the 
origin of the block of the current picture, (b) while mov- 
ing the block of the reference picture in a predetermined 
search area, obtaining a residual between the block of 
the current picture and the block of the reference pie- 
rs ture, (c) detecting a block with the minimum residual 
from the reference picture so as to calculate a moving 
vector, (d) extracting N pixels of the curent picture and N 
pixels of the reference picture at a time (where N is an 
integer), (e) storing the N pixels of the current picture 
20 and the N pixels of the reference picture as successive 
data to a memory and (f) reading pixels of the block of 
the current picture and pixels of the block of the refer- 
ence picture as successive data from the rriemory so as 
to obtain a residual. 
25 [0072] A tenth aspect of the present invention is a 
record medium on which a moving vector calculating 
program has been recorded, the moving vector calculat- 
ing program causing a system that has the record 
medium to perform the steps of (a) extracting a block 
30 from a reference picture corresponding to a block of a 
current picture to be processed, the size of the block of 
the reference picture being the same as the size of the 
block of the current picture, the origin of the block of the 
reference picture matching the origin of the block of the 
35 current picture, (b) while moving the block of the refer- 
ence picture in a predetermined search area, obtaining 
a residual between the block of the current picture and 
the block of the reference picture, (c) detecting a block 
with the minimum residual from the reference picture so 
40 as to calculate a moving vector, (d) extracting N pixels of 
the curent picture and N pixels of the reference picture 
at a time (where N is an integer), (e) storing the N pixels 
of the current picture and the N pixels of the reference 
picture as successive data to a memory, and (f) reading 
45 pixels of the block of the current picture and pixels of the 
block of the reference picture as successive data from 
the memory so as to obtain a residual. 
[0073] An eleventh aspect of the present invention is 
a moving vector calculating method, comprising the 
so steps of (a) extracting a block from a reference picture 
corresponding to a block of a current picture to be proc- 
essed, the size of the block of the reference picture 
being the same as the size of the block of the current 
picture, the origin of the block of the reference picture 
55 matching the origin of the block of the current picture, 
(b) while moving the block of the reference picture in a 
predetermined search area, obtaining a residual 
between the block of the current picture and the block of 
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the reference picture, (c) detecting a block with the min- 
imum residual from the reference picture so as to calcu- 
late a coarse moving vector, (d) while moving the block 
of the reference picture in the vicinity of the coarse mov- 
ing vector obtained at step (c), obtaining a residual 5 
between the block of the current picture and the block of 
the reference picture, (e) detecting a block with the min- 
imum residual from the reference picture so as to detect 
a fine moving vector, (f) storing pixels of the current pic- 
ture and pixels of the reference picture to a first memory, w 
(g) extracting N pixels of the current picture and N pixels 
of the reference picture at a time (where N is an inte- 
ger), and (h) storing the N pixels of the current picture 
and the N pixels of the reference picture as successive 
data to a second memory, wherein step (c) is performed 15 
with the N pixels of the current picture and the N pixels 
of the reference picture stored as successive data in the 
second memory, and wherein step (e) is performed with 
the pixels of the current picture and the pixels of the ref- 
erence picture stored in the first memory. 20 
[0074] A twelfth aspect of the present invention is a 
record medium on which a moving vector calculating 
program has been recorded, the moving vector calculat- 
ing program causing a system that has the record 
medium to perform the steps of (a) extracting a block 2s 
from a reference picture corresponding to a block of a 
current picture to be processed, the size of the block of 
the reference picture being the same as the size of the 
block of the current picture, the origin of the block of the 
reference picture matching the origin of the block of the 30 
current picture, (b) while moving the block of the refer- 
ence picture in a predetermined search area, obtaining 
a residual between the block of the current picture and 
the block of the reference picture, (c) detecting a block 
with the minimum residual from the reference picture so 35 
as to calculate a coarse moving vector, (d) while moving 
the block of the reference picture in the vicinity of the 
coarse moving vector obtained at step (c). obtaining a 
residual between the block of the current picture and the 
block of the reference picture, (e) detecting a block with 40 
the minimum residual from the reference picture so as 
to detect a fine moving vector, (f) storing pixels of the 
current picture and pixels of the reference picture to a 
first memory, (g) extracting N pixels of the current pic- 
ture and N pixels of the reference picture at a time 45 
(where N is an integer), and (h) storing the N pixels of 
the current picture and the N pixels of the reference pic- 
ture as successive data to a second memory, wherein 
step (c) is performed with the N pixels of the current pic- 
ture and the N pixels of the reference picture stored as so 
successive data in the second memory, and wherein 
step (e) is performed with the pixels of the current pic- 
ture and the pixels of the reference picture stored in the 
first memory. 

[0075] A thirteenth aspect of the present invention is ss 
a moving vector calculating method, comprising the 
steps of (a) extracting a block from a reference picture 
corresponding to a block of a current picture to be proc- 



essed, the size of the block of the reference picture 
being the same as the size of the block of the current 
picture, the origin of the block of the reference picture 
matching the origin of the block of the current picture, 
(b) while moving the block of the reference picture in a 
predetermined search area, obtaining a residual 
between the block of the current picture and the block of 
the reference picture, (c) detecting a block with the min- 
imum residual from the reference picture so as to calcu- 
late a moving vector, and (d) comparing contour pixels 
of the block of the reference picture with contour pixels 
of the block of the current picture so as to obtain a resid- 
ual therebetween. 

[0076] A fourteenth aspect of the present invention is 
a record medium on which a moving vector calculating 
program has been recorded, the moving vector calculat- 
ing program causing a system that has the record 
medium to perform the steps of (a) extracting a block 
from a reference picture corresponding to a block of a 
current picture to be processed, the size of the block of 
the reference picture being the same as the size of the 
block of the current picture, the origin of the block of the 
reference picture matching the origin of the block of the 
current picture, (b) while moving the block of the refer- 
ence picture in a predetermined search area, obtaining 
a residual between the block of the current picture and 
the block of the reference picture, (c) detecting a block 
with the minimum residual from the reference picture so 
as to calculate a moving vector, and (d) comparing con- 
tour pixels of the block of the reference picture with con- 
tour pixels of the block of the current picture so as to 
obtain a residual therebetween. 
[0077] These and other objects, features and advan- 
tages of the present invention will become more appar- 
ent in light of the following detailed description of a best 
mode embodiment thereof, as illustrated in the accom- 
panying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0078] 

Fig. 1 is a block diagram showing the structure of a 
conventional MPEG2 encoder; 
Fig. 2 is a schematic diagram for explaining a block 
matching process; 

Fig. 3 is a schematic diagram showing the structure 
of a conventional moving picture encoding appara- 
tus; 

Fig. 4 is a block diagram showing an example of the 
structure of a data processing apparatus according 
to the present invention; 

Fig. 5 is a flow chart for explaining an MPEG2 
encoding process; 

Fig. 6 is a schematic diagram for explaining a proc- 
ess of a block of the current frame in a moving vec- 
tor calculating process according to the present 
invention; 
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Fig. 7 is a schematic diagram for explaining a proc- 
ess of a block of the current frame in the moving 
vector calculating process according to the present 
invention; 

Fig. 8 is a schematic diagram for explaining a proc- 
ess of a block of the current frame in the moving 
vector calculating process according to the present 
invention; 

Fig. 9 is a schematic diagram for explaining a zig- 
zag scan process; 

Fig. 10 is a schematic dagram for explaining a 
process of a block of a reference frame in the mov- 
ing vector calculating process according to the 
present invention; 

Fig. 11 is a schematic diagram for explaining a 
process of a block of a reference frame in the mov- 
ing vector calculating process according to the 
present invention; 

Fig. 12 is a schematic cfiagram for explaining a 
process of a block of a reference frame in the mov- 
ing vector calculating process according to the 
present invention; 

Fig. 13 is a graph showing a function for determin- 
ing whether an irttra-frame encoding process or an 
inter-frame encoding process is performed; 
Fig. 14 is a graph showing a function for determin- 
ing whether an tntra-frame encoding process or an 
inter-frame encoding process is performed; 
Fig. 15 is a flow chart for explaining a moving vector 
calculating process according to the present inven- 
tion; 

Fig. 16 is a flew chart for explaining a moving vector 
calculating process according to the present inven- 
tion; 

Fig. 17 is a schematic cfiagram for explaining a 
checkerwise thin-out process; 
Figs. 18A. 18B, and 18C are schematic diagrams 
for explaining an arrangement of checkerwise data 
as successive data; 

Figs. 19A and 19B are schematic diagrams for 
explaining an encoding process of an MPEG2 
encoder according to the present invention; 
Fig. 20 a schematic diagram for explaining a mem- 
ory structure used in an encoding process of the 
MPEG2 encoder according to the present inven- 
tion; 

Fig. 21 is a timing chart for explaining an encoding 
process of the MPEG2 encoder according to the 
present invention; 

Fig. 22 is a flow chart for explaining a moving vector 
calculating process of the MPEG2 encoder accord- 
ing to the present invention; 
Fig. 23 is a flow chart for explaining a moving vector 
calculating process of the MPEG2 encoder accord- 
ing to the present invention; 
Fig. 24 is a flow chart for explaining a moving vector 
calculating process of the MPEG2 encoder accord- 
ing to the present invention; 
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Fig. 25 is a schematic diagram for explaining an 
embodiment of the present invention; 
Fig. 26 is a flow chart for explaining an embodiment 
of the present invention; 

Fig. 27 is a block diagram showing an example of 

the structure of a picture encoding apparatus 

according to the present invention; 

Fig. 28 is a schematic diagram for explairing a 

macro block extracting process used in a global 

vector detecting portion of the picture encoding 

apparatus; 

Fig. 29 is a schematic diagram for explairing a 
process for divicfing one picture into a plurality of 
areas and obtaining global vectors, the process 
being performed by the global vector detecting por- 
tion of the picture encoding apparatus; 
Fig. 30 is a flow chart for explaining a motion 
detecting process of the picture encoding appara- 
tus; 

Fig. 31 is a block diagram showing the structure of 
a picture encoding apparatus according to the 
present invention; and 

Rg. 32 is a flow chart for explaining an encoding 
process of the picture encoding apparatus accord- 
ing to the present invention. 



DETAILED D ESCRIPTION OF THE PREFFRRFD 
EMBODIMENTS 



30 [0079] Next, with reference to the accompanying 
drawings, embodiments of the present invention will be 
described. Rg. 4 is a block diagram showing an exam- 
ple of the structure of a data processing apparatus 
according to a first embodiment of the present inven- 
35 tion. 

[0080] Referring to Rg. 4, reference numeral 1 is a 
CPU (Central Processing Unit). Reference numeral 2 is 
a ROM (Read Only Memory). Reference numeral 3 is a 
RAM (Random Access Memory). The CPU 1. the ROM 
40 2, and the RAM 3 are connected to a processor bus 4. 
[0081] The CPU 1 is for example a processor having 
MMX function. The MMX function allows a moving pic- 
ture reproducing process, a picture editing process, and 
a sound synthesizing process, and so forth to be per- 
45 formed at high speed. With an MMX instruction that 
employs SIMD (Single Instruction MiJtiple Data) tech- 
nology, the same process can be performed for succes- 
sive data at a time. 

[0082] The ROM 2 stores a boot strap program. The 
so RAM 3 is a main memory as a working area. The rec- 
ommended storage capacity of the RAM 3 is for exam- 
ple 64 MB or more. 

[0083] The CPU 1 is connected to a bridge circuit 5. 
The bridge circuit 5 is connected to the processor bus 4. 
55 The bridge circuit 5 is connected to a PCI (Peripheral 
Component Interconnect) bus 6. The bridge circuit 5 
connects the CPU 1, the processor bus 4, and the PCI 
bus 6. 
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[0084] The PCI bus 6 is connected to an IDE (Inte- 
grated Device Electronics) controller 7, a SCSI (Small 
Computer System Interlace) controller 8, a graphics 
accelerator 9. and an IEEE (Institute Of Electrical and 
Electronics Engineers) 1394 controller 10. 
[0085] The IDE controller 7 is connected to a storage 
device 11 such as a hard disk drive or a CD diva The 
SCSI controller 8 is connected to a storage device 12 
such as a hard disk drive or a CD drive. The SCSI con- 
troller 8 is also connected to a peripheral unit such as an 
image scanner as well as a storage device. The graph- 
ics accelerator 9 is connected to a display 13. The IEEE 
1394 controller 10 is connected to a digital audio video 
unit such as a digital VCR (Video Cassette Recorder). 
[0086] The PCI bus 6 is connected to an ISA (Indus- 
trial Standard Architecture) bus 15 through a bridge cir- 
cuit 14. The bridge circuit 14 connects the PCI bus 6 
and the ISA bus 15. The ISA bus 15 is connected to an 
input device controller 16, a floppy disk controller 1 7, a 
parallel controller 18, and an RS232C controller 19. 
[0087] The input device controller 18 is connected to 
an input device 20 such as a keyboard or a mouse. The 
floppy disk controller 17 is connected to a floppy disk 
drive 21. A printer or the like can be connected to the 
parallel controller 18. Modem or the like can be con- 
nected to the RS232C controller 19. 
[0088] In the initial state, the boot strap program 
stored in the ROM 2 gets started so as to perform initial 
settings. Thereafter, the storage device 11 or 12 is 
accessed. An operating system stored in the storage 
device 11 or 12 is read. The operating system resides in 
the RAM 3 as a main memory. Thus, the operating sys- 
tem gets started. Under the control of the operating sys- 
tem, various processes are executed. 
[0089] In the example, the PCI bus and the ISA bus 
are used. However, according to the present invention, 
USB (Universal Serial Bus) can be used. A keyboard, a 
mouse, or the like can be connected to the USB. 
[0090] When the data processing apparatus shown in 
Fig. 4 performs the MPEG2 encoding process, an appli- 
cation program for performing the MPEG2 encoding 
process is executed. The application program is stored 
as an executable program in the storage device 11 such 
as an IDE hard disk or the storage device 12 such as a 
SCSI hard disk. When the application program is exe- 
cuted, it is read to the RAM 3 and sequentially executed 
by the CPU 1. 

[0091] The application program for performing the 
MPEG2 encoding process may be pre-installed to the 
storage device 11 such as an IDE hard disk or the stor- 
age device 1 2 such as a SCSI hard disk. Alternatively, a 
CD-ROM or a floppy disk may be provided with the 
application program for performing the MPEG2 encod- 
ing process in an executable format or a compressed 
format The user may install the program stored in the t 
CD-ROM or the floppy disk to the storage device 11 
such as an IDE hard disk or the storage deice 12 such 
as a SCSI hard disk. As another alternative method, the 



application program may be downloaded through a 
communication line. 

[0092] When the application program for performing 
the MPEQ2 encocfing process is executed, a moving 

s vector calculating process, a DCT calculating process, a 
quantizing process, and a variable length code encod- 
ing process are performed for digital video data corre- 
sponding to a prediction mode. The dgrtal video data is 
compressed corresponding to the MPEG2 method At 

10 this point as a working area, the RAM 3 is used. Calcu- 
lating operations for such processes are performed by 
calculating functions of the CPU 1. The digital video 
data is input from an external digital VCR or the like con- 
nected to the IEEE 1394 controller 10. Output data is 

is recorded to a hard dsk drive or the like connected to the 
SCSI controller 8 or the IDE controller 7. 
[0093] Fig. 5 is a flow chart showing the MPEG2 
encoding process of the program. 
[0094] As shown in Fig 5. digital video data of a plu- 

20 ralrty of frames is input. The digital video data is buffered 
to the RAM 3 (at step Si). By a block matching process, 
a moving vector is calculated (at step S2). In the block 
matching process, contour pixels of blocks may be 
used. 

25 [0095] It is determined whether or not the prediction 
mode is an I picture, a P picture, or a B picture (at step 
S3). When the prediction mode is an I picture as the 
determined result at step S3, the DCT process for each 
block of (8x8) pixels of tfie same frarne is performed (at 
30 step S4). The obtained coefficient data is quantized (at 
step S5) and then encoded with variable length code (at 
step S6). The resultant data is stored as data of a refer- 
ence picture to the RAM 3 (at step S7). 
(0096] When the prediction mode is a P picture as the 
35 determined result at step S3, data of a forward refer- 
ence picture is read from the RAM 3 (at step S8). The 
reference picture is rnotion-compensated correspond- 
ing to the moving vector calculated at step S2 (at step 
S9). Thus, the difference between the data of the cur- 
40 rent picture and the data of the reference picture that 
has been motion-compensated is obtained. The DCT 
process is performed for the difference between the 
data of the current picture and the data of the reference 
picture (at step S1 0). The obtained data is quantized (at 
45 step S1 1) and the encoded with variable length code (at 
step S12). The resultant data is stored as data of the 
reference picture to the RAM 3 (at step S13). 
[0097] When the prediction mode is a B picture as the 
determined result at step S3, data of bidirectional refer- 
so ence pictures is read from the RAM 3 (at step S14). The 
reference picture is motion-compensated correspond- 
ing to the moving vector calculated at step S2 (at step 
S15). The difference between the data of the current 
picture and the data of the reference pictures that have 
55 been motion-cornpensated is obtained. The DCT proc- 
ess is performed for the difference between the data of 
the current picture and the data of the reference pic- 
tures (at step S16). The obtained data is quantized (at 
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step S17) and encoded with variable length code (at 
step S18). 

[0098] The moving vector calculated at step S2 shown 
in Fig. 5 is performed in the following manner. A block 
with the same size and the same origin as a block s 
divided from the current frame to be processed is 
extracted from a reference frame. While the block of the 
reference frame is being moved in a predetermined 
search area, the sum of absolute values of difference 
values between pixels of the block of the reference w 
frame and pixels of the relevant block of the current 
frame is obtained as a residual. A block of the reference 
frame with the minimum residual is obtained. The block 
matching process requires many calculating steps. 
[0099] Thus, according to the present invention, the is 
block matching process is performed by orthogonally 
transforming data of blocks and comparing the blocks. 
As an example of the orthogonally transforming proc- 
ess. Hadamard transforming method is used. 
[0100] In other words, as shown in Fig. 6, data pieces 20 
CD1, CD2, .... and CD256 of a block CBLK of (16 x 16) 
pixels of the current frame are obtained. As shown in 
Fig. 7. the block CBLK of (16 x 16) pixels of the current 
frame is divided into four blocks TBLK_C1 to TBLK__C4 
each of which is composed of (8 x 8) pixels. As shown 2s 
in Fig. 8. the four blocks TBLK_C1 to TBLK_C4 are 
orthogonally transformed into spectrum data pieces 
TCD1-1 to TCD1-64. TCD2-1 to TCD2-64, TCD3-1 to 
TCD3-64, and TCD4-1 to TCD4-64. Data pieces of the 
four blocks TBLKC1 to TBLK_C4 are obtained in the 30 
order of lower spatial frequency data pieces by zigzag 
scanning method as shown in Fig. 9. 
[0101] Likewise, as shown in Fig. 10. data pieces 
RD1. RD2, .. .. and RD256 of a block RBLK of (16 x 16) 
pixels of a reference frame are obtained. As shown in 35 
Fig. 11. the block RBLK of the reference frame is 
divided into four blocks TBLK_R1 to TBLKR4. As shown 
in Fig. 12, the four blocks TBLK_R1 to TBLK_R4 are 
orthogonally transformed into spectrum data pieces 
TRD1-1 to TRD1-64. TRD2-1 to TRD2-64. TRD3-1 to 40 
TRD3-64. and TRD4-1 to TRIM -64. Data pieces of the 
four blocks TBLK_R1 to TBLK_R4 are obtained in the 
order of lower spatial frequency data pieces by zigzag 
scanning method as shown in Fig. 9. 
[0102] When a video signal is orthogonally trans- 45 
formed, energy concentrates on low frequency data. 
Thus, high frequency data does not almost exist Con- 
sequently, when data pieces of the four blocks 
TBLK_C1 to TBLKC4 are obtained by the zigzag scan- 
ning method, the number of data pieces is limited to a so 
predetermined value. In this example, the number of 
data pieces obtained is fimrted to 10. However, accord- 
ing to the present invention, the number of data pieces 
obtained may be a value other than 10. Likewise, when 
data pieces of the four blocks TBLK R1 to TBLKR4 of 55 
the reference frame are obtained by the zigzag scan- 
ning method, the number of data pieces obtained is lim- 
ited to a predetermined value. In this example, the 



number of data pieces obtained is limited to 10. 
[0103] In other words, for example. 10 data pieces 
(denoted by black dots shown in Fig. 8) are obtained 
from the four blocks TBLK_C1 to TBLK_4 of the current 
frame. Likewise, for example, 10 data pieces (denoted 
by black dots shown in Fig. 12) are obtained from the 
four blocks TBLK.R1 to TBLK_R4 of the reference 
frame. The sum of the absolute values of the cfifference 
values between the data pieces obtained from the four 
blocks TBLKC1 to TBLKC4 of the current frame and 
the data pieces obtained from the fourth blocks 
TBLK_R1 to TBLK_R4 of the reference frame is 
obtained as a residual. 

fl>104] In the block matching process, since data of 
one block is orthogonally transformed and the number 
of data pieces is limited to a predetermined value, the 
number of calculating steps can be remarkably 
decreased. Thus, the calculating speed is improved. 
[01 05] In other words, as described above, one block 
is divided into four blocks. The four blocks are orthogo- 
nally transformed (by for example Hadamard transforrn- 
ing method). The number of data pieces of each 
orthogonally transformed block is limited to 10. In this 
condition, the block matching process is performed. In 
this case, since the number of data pieces is limited to 
10 and one block is divided into four blocks, the number 
of calculating steps for obtaining the residual in the 
block matching process is 40. In contrast, when the 
block matching process is performed with a block com- 
posed of (16 x 16) pixels, the number of calculating 
steps becomes (16 x 16 = 256). Thus, when a residual 
is obtained with one block that is orthogonally trans- 
formed, the number of calculating steps can be remark- 
ably decreased. 

[0106] In this case, the orthogonally transforming 
method such as Hadamard transforming method should 
be used. However, the Hadamard transforming method 
can be performed with simple arithmetic operations 
such as additions and subtractions. Thus, the number of 
calculating steps does not largely increase. 
[0107] In the MPEG2 encoding process, a picture of 
the current frame is used as a picture of the next refer- 
ence frame. Thus, when orthogonally transformed data 
of a block of a picture of the current frame is stored, it 
can be used as data of a reference frame. 
[0108] When a moving vector is searched, search 
areas overlap. In an overlapped area, the same orthog- 
onally transformed data is required. Thus, for a block of 
a reference frame, orthogonally transformed data that 
has been moved pixel by pixel is stored. In this case, 
when search areas overlap, the stored data can be 
used. 

[01 09] In the above-descrfoed example, as the orthog- 
onally transforming method, the Hadamard transform- 
ing method was used. However. accorrJng to the 
present invention, for example, DCT transforming 
method or FFT (Fast Fourier Transform) can be used. 
[01 10] In the above-descnbed example, a block of (16 
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x 16) pixels is divided into four blocks each of which is 
composed of (8 x 8) pixels. The four divided blocks are 
orthogonally transformed. Alternatively, a block of (16 x 
16) pixels may be directly orthogonally transformed. 
However, when one block is divided into four blocks and 5 
the four blocks are orthogonally transformed, the trans- 
forming algorithm becomes simple. In addition, a gen- 
eral-purpose orthogonally transforming circuit and 
algorithm can be used. 

[0111] Next a second embodiment of the present w 
invention will be described. According to the second 
embodiment in the middle of the block matching calcu- 
lating loop, the sum of the absolute values of the differ- 
ence values between pixels of a block of the current 
frame and pixels of the relevant block of a reference is 
frame is compared with a predetermined threshold 
value. When the sum is equal to or larger than the pre- 
determined threshold value, the process is terminated. 
Thus, the number of calculating steps can be 
decreased. Consequently, a moving vector can be 20 
detected at high speed. 

[0112J The threshold value is assigned corresponding 
to the sum of mean discrete absolute values (MAD) and 
a residual AD (0, 0) at the origin. Thus, since the thresh- 
old value is dynamically assigned, the process can be 2s 
effectively performed. 

[0113] In the case of a P picture and a B picture, the 
intra-frame encoding process may be performed for 
each macro block (in Fig. 5, for simplicity, in the case of 
a P picture and a B picture, the inter-frame encoding 30 
process is performed with a reference frame). In other 
words, the inter-frame encoding process can compress 
a picture more effectively than the intra-frame encoding 
process. However, in the case of a picture that contains 
many DC components or a picture that largely moves 3s 
(namely, the sum of the absolute values of the differ- 
ence values between pixels of a block of the current 
frame and pixels of the relevant block of a reference 
frame is large), the intra-frame encoding process can 
compress the picture more effectively than the inter- 40 
frame encoding process. When the intra-frame encod- 
ing process is performed, since the moving vector cal- 
culating process is not required, inaccuracy of the 
moving vector is permissible. 

[0114] When the sum of the absolute values of the dif- 4s 
ference values between pixels of a block of the current 
block and pixels of the relevant block of a reference 
block is equal to or larger than the predetermined 
threshold value, the process is terminated. Thus, rf a 
large value is assigned to the threshold value, the prob- so 
ability of which the process is terminated in the middle 
becomes high. In contrast when a small value is 
assigned to the threshold value, the probability of which 
a moving vector is inaccurately detected becomes high. 
However, when the intra-frame encoding process is per- ss 
formed, since the moving vector calculating process is 
not required, inaccuracy of the moving vector is permis- 
sive. Thus, when a residual obtained in the intra-frame 



encoding process is used as the threshold value, the 
efficiency of the process is improved. 
[0115] When a P picture and a B picture are encoded, 
the intra-frame encoding process is performed corre- 
sponding to the value of the MAD and the residual AD 
(x, y) of the detected moving vector. 
[01 16] The MAD is the sum of the absolute values of 
the cSfference values between the values of pixels of 
one frame and the mean value thereof. The MAD is 
obtained as follows. 

16 16 

MAD = Z Z l pi *el{x.y) - AVE_BLOCK\ 

x=1 y»1 

16 1B 

£ 2 «*/(*./) 

AVE_BLOCK = * =1 M 

256 



[0117] The MAD represents the complication of a pat- 
tern of one block of a picture. Thus, when a pattern is 
simple, the value of the MAD is small. In contrast when 
a pattern is complicated, the value of the MAD is large. 
[0118] Thus, with a function shown in Fig. 13, it is 
determined whether the intra-frame encoding process 
or the inter-frame encoding process is performed. In 
Rg. 13. the horizontal axis represents the value of the 
residual AD {x, y) at the position of a moving vector, 
whereas the vertical axis represents the value of the 
MAD. In Fig. 13, when both the value of the MAD and 
the value of the residual (x. y) at the position of a moving 
vector are in an area AR1, the intra-frame encoding 
process is performed. When they are in an area AR2, 
the inter-frame encoding process is performed. When 
the value of the MAD is small, since the pattern of the 
current block is simple, this function represents that the 
intra-frame encoding process is performed. When the 
valueof the residual AD (x. y) at the position of the mov- 
ing vector is small, this function represents that the 
inter-frame encoding process is performed instead of 
the intra-frame encoding process. 
[01 1 9] In the middle of the block matching process, 
the sum of the absolute values of the difference values 
between pixels of a block of the current frame and pixels 
of the relevant block of a reference frame is compared 
with a predetermined threshold value, when the sum is 
equal-to or larger than the threshold value, the process 
is terminated. In addition, corresponding to functions 
shown in Figs. 13 and 14 with the valueof the MAD and 
the value of the residual AD (0. 0) at the origin, it is 
determined whether the intra-frame encoding process 
or the inter-frame encoding process is performed. In 
addition, it is determined whether or not the motion 
compensation is performed. As the determined results, 
the initial value of the threshold value is assigned. Thus! 
a moving vector can be effectively calculated. Fig. 15 
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shows a flow chart showing such a process. 
[0120] Since the threshold value that is initially 
assigned in the block matching process is not always 
small, when a moving vector is detected at first, the 
threshold value is obtained with the value of the MAD s 
and the value of the residual AD (0, 0) at the origin. In 
me r>extWc<^ matching process for the 
original threshold value or the obtained sum whichever 
smaller is used. Thus, the process can be effectively 
performed. w 
[0121] In Fig. 15. the search area of a block of a refer- 
ence frame is initially set (at step S21). Thereafter, the 
values of the MAD is obtained (at step S22). The value 
of the residual AD (0. 0) at the origin is obtained (at step 
S23). Corresponding to the value of the MAD and the is 
value of the residual AD (0, 0) at the origin, the initial 
value of the ADmin is set (at step S24). 
[0122] The value of the ADmin represents the mini- 
mum value of the residual that has been obtained. The 
initial value of the ADmin becomes the initial value of the 20 
threshold value of the sum of the absolute values of the 
difference values between pixels of a block of the cur- 
rent frame and pixels of the relevant block of a reference 
frame. The value of the ADmin is dynamically set 
depending on whether the infra-frame encoding proc- 25 
ess or the inter-frame encoding process is performed 
and whether or not the motion compensating process is 
Performed corresponding to the functions shown in 
Figs. 13 and 14. 

[0123] After the initial value of the ADmin has been set 30 
at step S24, the upper right position of the search area 
is selected for the first block matching process (at step 
S25). For a block at the initial position, the block match- 
ing process is performed (at step S26). 
[0124] In the middle of the block matching process, 3S 
the sum of the absolute values of the difference values 
between pixels of a btock of the current frame and pixels 
of the relevant btock of a reference frame is compared 
with a predetermined threshold value. When the sum is 
equal to or larger than the predetermined threshold 40 
value, the process is terminated. When the btock match- 
ing process is initially performed, as the threshold value, 
the initial value of the ADmin obtained at step S24 is 
used. Fig. 16 is a flow chart showing the btock matching 
process. ^ 
[0125] Referring to Pig. 16, in the btock matching proc- 
ess (at step S26), a pixel position is initially set (at step 

541) . The value of the residual AD is initially set (at step 

542) . A residual is obtained with the sum of the absolute 
values of the Difference values between pixels of a ref- so 
erence frame and pixels of a current frame (at step 

543) . In the middle of the block matching process, it is 
determined whether or not the sum of the absolute val- 
ues of the difference values between pixels of the refer- 
ence frame and pixels of the current frame exceeds the 55 
value of the ADmin (at step S44). When the determined 
result at step S44 is Yes (namely, the sum exceeds the 
value of the ADmin), the block matching process is ter- 



minated. The flow returns to the main routine When the 
determined result at step S44 is No (namely, the sum 
does not exceed the value of the ADmin), it is deter- 
mined whether or not the btock matching process has 
been performed for all the pixels (at step S45). When 
the determined result at step S45 is No (namely, the 
btock matching process has not been performed for all 
the pixels), the flow returns to step S43. At step S43, the 
sum of the absolute values of the difference values 
between pixels of the reference frame and pixels of the 
current frame is continued. When the determined result 
at step S45 is Yes (namely, the btock matching process 
has been performed for all the pixels), the btock match- 
ing process is terminated. Thereafter, the flow returns to 
the main routine. 

PM26] As described above, in the btock matching 
process, it is determined whether or not the value of the 
AD exceeds the value of the ADmin at step S44. When 
the determined result at step S44 is Yes (namely, the 
value of the AD exceeds the value of the ADmin), the 
flow returns to the main routine. Thus, the value of the 
ADmm becomes the threshold value. In the middle of 
meWockrnatehingrxocess,thesumcrf 
ues of the difference values between pixels of a block of 
the current frame and pixels of the relevant btock of the 
reference frame is compared with the threshold value. 
When the sum exceeds the rxedeterrnined threshold 
value, the btock matching process is terminated. Thus, 
the number of calculating steps is decreased. Conse- 
quently, a moving vector can be detected at high speed. 
[01 27] In addition, the value of the ADmin used as the 
initial value of the threshold value is set corresponding 
to the value of the MAD and the value of the residual AD 
(0, 0) at the origin. When a residual represents that the 
intra-frame encoding process is performed, since a 
moving vector is not required, inaccuracy of the moving 
vector is permissible. Since the threshold value is 
dynamically varied, when a residual exceeds a value at 
which a moving vector is not required, the probability of 
which the btock matching process is terminated 
becomes high. Thus, the number of calculating steps is 
further decreased. 

[0128] In Fig. 15, the value of the AD obtained in the 
btock matching process is compared with the minimum 
value Amin that has been obtained (at step S27). When 
the determined result at step S27 is Yes (namely, the 
value of the AD is smaller than the minimum value 
ADmin), the current sum AD is used as the minimum 
value ADmin (at step S28). The value of the AD is 
recorded as the moving vector MV (at step S29). There- 
after, the next btock is processed (at step S30). There- 
after, it is determined whether or not the last btock has 
been processed (at step S31). When the determined 
result at step S31 is No (namely, the last btock has not 
been processed), the flow returns to step S26. At step 
S26. the btock matching process is performed for the 
next block. 

[0129] As shown in Rg. 16. in the middle of the btock 
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matching process, the sum of the absolute values of the 
difference values between pixels of a block of the cur- 
rent frame and pixels of the relevant block of the refer- 
ence frame is compared with a predetermined threshold 
value. When the sum is equaJ to or larger than the pre- 5 
determined threshold value, the process is terminated. 
As the threshold value, the value of the ADmin is used. 
[0130] At step S27, the value of the AD that has been 
obtained in the block matching process is compared 
with the value of the ADmin that has been obtained, w 
When the determined result at step S27 is Yes (namely; 
the value of the AD is smaller than the current minimum 
value ADmin), the value of the AD becomes the value of 
the ADmin. Thus, when the value of the AD that has 
been obtained is larger than the value of the ADmin, the is 
next threshold value is the same as the original thresh- 
old value. When the value of the AD is smaller than the 
value of the ADmin, the next threshold value becomes 
the minimum value of the AD. Thus, in the block match- 
ing process shown in Fig. 16, when a residual exceeds 20 
the value of the ADmin, the process is terminated. 
[0131] Thereafter, a loop from step S26 to step S31 is 
repeated. The minimum value of the sum of the abso- 
lute values of the difference values between pixels of a 
block of the current frame and pixels of the relevant 25 
block of the reference frame is obtained. At step S31, it 
is determined whether or not the last block has been 
processed. When the determined result at step S31 is 
Yes (namely, the last block has been processed), the 
minimum value ADmin becomes the moving vector MV 30 
The result is stored (at step S32). 
[0132] In the above-descrfced example, the initial 
value of the threshold value is assigned corresponding 
to the value of the MAD and the value of the residual AD 
(x, y) at the origin. However, according to the present 35 
invention, the threshold value may be assigned corre- 
sponolng to one of the value of the MAD and the value 
of the residual AD (x. y) at the origin. 
[0133] In a third embodiment of the present invention, 
as shown in Fig. 17, the block matching process is per- 40 
formed by checkerwise thinning out pixels of a block of 
a reference frame and pixels of a relevant block of the 
current frame. 

[0134] Referring to Fig. 1 7, a block 31 of a reference 
fraireisOTrTipo6edof(16x16) 45 
obtained checkerwise from the block 31. Likewise, a 
block 32 of the current frame is composed of (16 x 16) 
pixels. (8x16) pixels are obtained checkerwise from the 
block 31. 

[0135] At this point, the pixels of the current frame and so 
the pixels of the reference frame that have been 
obtained checkerwise are stored as successive data to 
a memory (a predetermined area of the RAM 3) so that 
the block matching process can be performed effec- 
tively with an MMX instruction. 55 
[01 36] In other words, as shown in Fig. 1 8A, pixels of 
the current frame and pixels of the reference frame are 
obtained checkerwise. As shown in Fig. 188, the pixels 



that have been thinned out checkerwise are rearranged 
as successive data. As shown in Fig. 18C. the pixels 
that have been thinned out checkerwise are stored to 
successive addresses of the memory. 
[0137] When the pixels of the current frame and the 
pixels of the reference frame are stored as successive 
data to the memory, since the block matching process 
can be performed with an MMX instruction, the process 
can be performed at high speed. 
[01 38] When the pixels of the current frame and the 
pixels of the reference frame that have been thinned out 
checkerwise are stored as successive data to the mem- 
ory, since two pixels are searched at a time, a logarith- 
mically searching process can be easily performed as 
well as the availability of an MMX instruction. 
[0139] In the logarithmically searching process, a 
point with the minimum residual is coarsely searched in 
a search area. Thereafter, a point with the minimum 
residual is finely searched around the coarsely 
searched point. As a result, a moving vector is detected. 
[0140] When pixels of the current frame and pixels of 
the reference frame that have been obtained checker- 
wise are stored as successive data to the memory, the 
logarithmically searching process is performed in the 
following manner. 

[0141 ] A f irst memory that stores ail pixels of the cur- 
rent frame and all pixels of the reference frame and a 
second rnernory (or a memory area) that stores pixels of 
the current frame and pixels of the reference frame that 
have been obtained checkerwise as successive data 
are prepared. Using me second memory, a moving vec- 
tor is searched coarsely at two pixel step. After a moving 
vector has been coarsely detected, using the first mem- 
ory, a moving vector is finely searched in the vicinity of 
the obtained point pixel by pixel. Thus, a moving vector 
can be f inally detected. 

[0142] For example, as shown in Fig. 19A. picture 
data pieces F1. F2, F3 t F4, F5. F6, F7, and so forth of 
each frame are input. The input picture data pieces F1 , 
F2, F3, F4, F5, F6. F7, and so forth are encoded into 
MPEG2 picture data pieces PI , P2. P3, P4, P5. P6. P7, 
and so forth in the order of I, B, B, P ( B, B, and P pc- 
tures. 

[01 43] In such an encoding process, as shown in Fig. 
20, to obtain a moving vector, the working area RAM 3 
has memory areas 21 A to 21F and memory areas 22A 
to 22C. The memory areas 21 A to 21 F store all pixels of 
one frame. The memory areas 22A to 22C store pixels 
of one frame that have been obtained checkerwise as 
successive data. 

[01 44] When the picture data pieces F1 , F2, F3. and 
so forth are input as shown in Fig. 21, the picture data 
pieces of each frame are stored to the memory areas 
21 A to 21 F. In addition, pixels are obtained checkerwise 
from the picture data pieces sample by sample. The 
resultant pixels are arranged to successive addresses 
and stored as picture data pieces fl. f2, 13, and so forth 
to the memory areas 22A to 22C. 
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[0145] In other words, at time point T1, the picture 
data piece F1 is stored to the memory area 21 A. At time 
point T2, the picture data piece F2 is stored to the mem- 
ory area 21 B. At time point 73. the picture data piece F3 
is stored to the memory area 21C. At time point T4, the 
picture data piece F4 is stored to the memory area 21 D. 
[0146] At time point T4, pixels are obtained from the 
picture data piece F1 checkerwise sample by sample. 
The picture data piece f1 arranged to successive 
addresses is stored to the memory area 22 A. Pixels are 
obtained from the picture data piece F4 checkerwise 
sample by sample. The picture data piece f4 arranged 
to successive addresses is stored to the memory area 
22B. 

[0147] At time point T5. the picture data piece F5 is 
stored to the memory area 21 E. Pixels are obtained 
from the picture data piece F2 checkerwise sample by 
sample. The picture data piece f2 arranged to succes- 
sive addresses is stored to the memory area 22C. 
[0148] At time point T6, the picture data piece F6 is 
stored to the memory area 21 R Pixels are obtained 
from the picture data piece F3 checkerwise sample by 
sample. The picture data piece f3 arranged to succes- 
sive addresses is stored to the memory area 22C. 
[0149] At time point 77. the picture data piece F7 is 
stored to the memory area 21A. Pixels are obtained 
from the picture data piece F7 checkerwise sample by 
sample. The picture data piece f7 arranged to succes- 
sive addresses is stored to the memory area 22A. 
[0150] As shown in Fig. 21, picture data pieces of 
each frame are stored to the memory areas 21 A to 21 F. 
In addition, pixels are obtained from picture data pieces 
checkerwise sample by sample. Picture data pieces 
arranged to successive addresses are stored to the 
memory areas 22A to 22C. 

[0151] With the picture data pieces F1, F2, F3, and so 
forth stored in the memory areas 21A to 21F and the 
picture data pieces f 1,12, f3. and so forth stored in the 
memory areas 22A to 22C. a moving vector is obtained. 
A moving vector is searched in a predetermined search 
area at two pixel step. A moving vector is searched in 
the vicinity of the searched point pixel by pixel. In other 
words, a moving vector is obtained by the logarithmic 
searching process. 

[0152] Since the picture data piece P1 is an I picture, 
it can be encoded from time point T1 to time point T3. 
[0153] At time point T4, the picture data piece P4 that 
is a P picture is encoded. A moving vector of the picture 
data piece P4 is obtained. For the picture data piece P4, 
the picture data piece F1 is used as a reference frame 
and the picture data piece F4 is used as the current 
frame. In this case, in the course searching process (at 
two pixel step), as a block of a reference frame, the pic- 
ture data piece f1 stored in the memory area 22A is 
used. As a block of the current frame, the picture data 
piece f4 stored in the memory area 22B is used. In the 
fine searching process (at one pixel step), as a block of 
the reference block, the picture data piece F1 stored in 



the memory area 21 A is used. As a block of the current 
frame, the picture data piece F4 stored in the memory 
area 21 D is used. 

[01 54] At time point T5, the picture data piece P2 that 
5 isaBpictoreisenaxjed.Amovi^ 

data piece P2 is obtained. For the picture data piece P2, 
as reference frames, the picture data pieces F1 and F4 
are used. As the current frame, the picture data piece 
F2 is used. In this case, in the coarse searching process 
10 (at two pixel step), as blocks of the reference frames, 
the picture data piece fl stored in the memory area 22A 
and the picture data piece f 4 stored in the memory area 
22B are used. As a block of the current frame, the pic- 
ture data piece f2 stored in the memory area 22C is 
is used. In the fine searching process (at one pixel step), 
as blocks of the reference frames, the picture data piece 
Fl stored in the memory area 21 A and the picture data 
piece F4 stored in the memory area 21 D are used. As a 
block of the current frame, the picture data piece F2 
20 stored in the memory area 21 Bis used. 

[0155] At time point T6, the picture data piece P3 that 
is a B picture is encoded. A moving vector of the picture 
P3 is obtained. For the picture data piece P3, as refer- 
ence frames, the picture data pieces F1 and F4 are 
25 used. As the current frame, the picture data piece F3 is 
used. In this case, in the coarse searching process (at 
two pixel step), as blocks of the reference frames, the 
picture data piece f1 stored in the memory area 22A 
and the picture data piece f4 stored in the memory area 
30 22B are used. As a block of the current frame, the pic- 
ture data piece f3 stored in the memory area 22C is 
used. In the fine searching process (at one pixel step), 
as blocks of the reference frames, the picture data piece 
Fl stored in the memory area 21 A and the picture data 
as piece F4 stored in the memory area 21D are used. Asa 
block of the current block, the picture data piece F3 
stored in the memory area 21 C is used. 
[01 56] At time point T7, the picture data piece P7 that 
is a P picture is encoded. A moving vector of the picture 
40 P7 is obtained. For the picture data piece P7. as a refer- 
ence frame, the picture data piece F4 is used. As the 
current frame, the picture data piece F7 is used. In this 
case, in the coarse searching process (at two pixel 
step), as a block of the reference frame, the picture data 
45 piece f4 stored in the memory area 22B is used. As a 
block of the current frame, the picture data piece fl 
stored in the memory area 22A is used. In the i'me 
searching process (at one pixel step), as a block of the 
reference frame, the picture data piece f4 stored in the 
so memory area 21D is used. As a block of the current 
frame, the picture data piece F7 stored in the memory 
area 21 A is used. 

[0157] Next, likewise, at time point T8. a moving vector 
of the picture data piece P5 that is a B picture is 
55 obtained. At time point T9, a moving vector of the pic- 
ture data piece P6 that is a B picture is obtained. 
[0158] Fig. 22 is a flow chart showing a logarithmic 
searching process for calculating a moving vector. In 
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Fig. 22, input picture data is stored Pixels are extracted 
checkerwise from a reference frame and the current 
frame sample by sample. The pixels that have been 
thinned out checkerwise are arranged as successive 
data and stored (at step S1 21). 5 
[0159] Thereafter, it is determined whether or not all 
blocks of the picture have been processed (at step 
S122). 

[0160] When the determined result at step S122 is No 
(namely, all the blocks of the picture have not been proc- 10 
essed). while the block is being moved in a predeter- 
mined search area at two pixel step, a moving vector is 
searched (at step S123). 

[0161 ] After a moving vector has been detected, while 
the block is being moved in the vicinity of the detected is 
moving vector pixel by pixel, a moving vector is 
searched (at step S124). 

[0162] The detected result is stored (at step S125). 
Thereafter, the next block is processed (at step S126). 
Thereafter, the flow returns to step S122. When the 20 
determined result at step S122 is No (namely, an the 
blocks have net been processed), the similar process is 
repeated. Thus, the moving vector of the next block is 
obtained. After the moving vector of the last block of pic- 
ture has been obtained, since the determined result at 2s 
step S122 is Yes, the process is completed. 
[0163] Rg. 23 is a flow chart showing the coarse 
searching process (at two pixel step) at step S123 
shown in Fig. 22. In the coarse searching process (at 
two pixel step), pixels of the current frame and pixels of 30 
the reference frame are extracted checkerwise. The 
extracted pixels are stored as successive data to a 
memory. 

[0164] In Rg. 23. the start point of the search area is 
set (at step S131). The vertical search start position is 35 
reset to the upper end (at step S132). In the vertical 
direction, it is determined whether or not the lower end 
has been detected (at step S133). When the deter- 
mined result at step S133 is No (namely the lower end 
has not been detected), the horizontal position is reset 40 
to the left end (at step S134). 
[0165] Thereafter, it is determined whether or not the 
n ght end of the search area has been detected (at step 
S135). When the determined result at step S1 35 is No 
(namely, the right end of the search area has not been 45 
detected), the block matching process is performed for 
a checkerwise block of (8 x 18) pixels and a residual is 
obtained (at step S136). 

[0166] At the point rt is determined whether or not the 
value of the residual AD is smaller than the minimum so 
value ADmin that has been obtained (at step S137). 
When the determined result at step S137 is Yes 
(namely, the value of the residual AD is smaller than the 
minimum value ADmin), the value of the residual AD is 
the minimum value ADmin. In addition, the moving vec- 55 
tor VT is the current position (at step S138). Thereafter, 
the horizontal position is moved for two pixels (at step 
S139). The pixels of the current frame and the pixels of 



the reference frame are extracted checkerwise and 
stored as successive data to the memory. Thus, when 
the horizontal position is moved for two pixels, the 
address is moved for one position in the memory. 
[0167] When the determined result at step S137 is No 
(namely, the value of the residual AD is not smaller than 
the minimum value ADmin), the flow advances to step 
S139. AtstepS139, the horizontal position is moved for 
two pixels. Thereafter, the flow returns to step S135. 
[0168] At step S135, it is determined whether or not 
the right end of the search area has been detected. 
When the determined result at step S135 is No (namely, 
the right end of the search area has not been detected)! 
the similar process is repeated. Thus, while the block is 
being moved to the right residuals are obtained. The 
minimum residual is stored as the minimum ADmin. 
[0169] When the determined result at step S1 35 is Yes 
(namely, the right end of the search area has been 
detected), the block is vertically moved for two pixels (at 
step S140). Thereafter, the flow returns to step S133. 
Thereafter, the similar process is performed. 
[0170] When the determined result at step S1 33 is Yes 
(namely, the lower end of the search area has been 
detected), the result is stored as a moving vector MV (at 
step S141). The moving vector MV becomes a refer- 
ence point of the fine searching process. 
[0171] Rg. 24 is a flow chart showing the fra search- 
ing process at step S24 shown in Rg. 22. In the fine 
searching process, the memory that stores all pixels of 
the current frame and ail pixels of the reference frame is 
used. 

[01 72] In Fig. 24, the start point is set at the upper left 
of the reference point obtained at step S141 shown in 
Rg. 23 (at step S151). The vertical search start position 
is reset to the upper end (at step S1 52). Thereafter, it is 
determined whether or not the lower end of the search 
area has been detected (at step S1 53). When the deter- 
mined result at step S153 is No (namely, the lower end 
has not been detected), the horizontal posrton is reset to 
the left end (at step S154). 

[01 73] Thereafter, it is determined whether or not the 
right end of the search area has been detected (at step 
S155). When the determined result at step S155 is No 
(namely, the right end of the search area has not been 
detected), the block matching process is performed for 
a block of (16 x 16) pixels and a residual is obtained (at 
step S156). 

[01 74] Thereafter, it is determined whether or not the 
value of the residual AD is smaller than the minimum 
value ADmin that has been obtained (at step S157). 
When the determined result at step S157 is Yes 
(namely, the value of the residual AD is smaller than the 
minimum value ADmin), the value of the residual AD is 
the minimum value ADmin (at step S158). The moving 
vector MV is the current position. The horizontal posi- 
tion is moved for one pixel (at step S159). 
[01 75] When the determined result at step S1 57 is No 
(namely, the value of the residual AD is not smaller than 
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the minimum value ADmin), the flow advances to step 
S159. At step S159, the horizontal position is moved for 
one pixel. Thereafter, the flow returns to step S155. 
[0176] At step S1 55. it is determined whether or not 
the right end of the search area has been detected. 
When the determined result at step S1 55 is No (namely, 
the right end of the search area has not been detected), 
the similar process is repeated. Thus, while the block is 
being moved from the left to the right in the search area, 
residuals are obtained. The minimum residual that has 
been obtained is stored as the minimum value ADmin. 
[0177] When the determined result at step S1 55 is Yes 
(namely, the right end of the search area has been 
detected), the block is moved for one pixel in the vertical 
direction (at step S160). Thereafter, the flow returns to 
step S153. Thereafter, the similar process is performed. 
[0178] When the determined result at step S1 53 is Yes 
(namely, the lower end of the search area has been 
detected), the moving vector VM is obtained and the 
process is completed. 

[0179] In the abov&elescribed example, pixels of the 
reference frame and pixels of the current frame are 
extracted checkerwise. However, according to the 
present invention, the thin-out step and the thin-out 
method are not Bmfted to those of the above-described 
example, 

[0180] In the above-descrfeed example, when the log- 
arithrnic searching process is performed, in the memory 
that stores pixels that have been thinned out for each 
sample by the coarse searching process, the address is 
moved for each position so as to search a moving vector 
at two pixel step. After natively, by moving the address 
tor two positions at a time, a searching process with four 
pixels at a time can be performed. Likewise, by moving 
the address for three positions at a time, a searching 
process with six pixels at a time can be performed. In 
the above-described example, the logarithmically 
searching process is performed by a coarse searching 
process with two pixels a at time and a fine searching 
process at one pixel step. Alternatively, the togarithmi- 
cafly searching process can be performed in a plurality 
of stages. 

[0181] According to the present invention, pixels of a 
reference frame and pixels of the current frame are 
thinned out checkerwise and then the block matching 
process is performed. At this point, the pixels of the cur- 
rent frame and the pixels of the reference frame are 
stored as successive data to a memory. Thus, when the 
block matching process is performed, since an MMX 
instruction can be effectively used, the process can be 
performed at high speed. 

[0182] In addition, a first memory that stores pixels of 
a current frame and pixels of a reference frame and a 
second memory that stores pixels of the current frame 
and pixels of the reference frame that have been 
thinned out checkerwise are prepared. With the second 
memory, a coarse searching process at two pixel step is 
performed. In this case, since the pixels of the current 



frame and the pixels of the reference frame that have 
been thinned out checkerwise are stored as successive 
data to the second memory, when the reference block is 
moved for each position in the second memory, a mov- 
5 ing vector is searched at two pixel step. After the moving 
vector has been obtained by the coarse searching proc- 
ess at two pixel step, using the first memory, the fine 
searching process at one pixel step is performed in the 
vicinity of the point obtained in the coarse searching 
w process. 

[0183] Thus, when pixels of the current frame and pix- 
els of the reference frame that have been obtained 
checkerwise are stored as successive data to a mem- 
ory, since a moving vector is searched at two pixel step, 
is the logarithmic searching process can be easily per- 
formed as well as the availability of an MMX instruction. 
B>184] The moving vector calculating process as step 
S2 shown in Fig. 5 is performed by the block matching 
process. In the block matching process, a moving vector 
20 is obtained by a block matching process. In other words, 
a block with the same size and the same origin as a 
block divided from the current frame to be processed is 
extracted from a reference frame. While the block of the 
reference frame is being moved in a predetermined 
25 search area, the sum of the absolute values of the differ- 
ence values between pixels of the block of the reference 
frame and pixels of the relevant block of the current 
frame is obtained as a residual. A block of the reference 
frame with the minimum residual is obtained. Thus, con- 
30 ventionally, since a residual is obtained as the sum of 
the absolute values of the difference values between 
pixels of a block of the current frame and pixels of the 
relevant block of a reference frame. However, since the 
number of calculating steps becomes huge, the moving 
35 vector calculating process cannot be performed at high 
speed. 

[0185] Thus, according to a fourth embocfiment of the 
present invention, a residual is obtained by calculating 
the sum of the absolute values of the difference values 
40 between pixels of the contour of a Week of the current 
frame and pixels of the contour of the relevant Week of a 
reference frame. 

[01 86] In other words, in Rg. 25, one block of a refer- 
ence frame is composed of (16 x 16) pixels. Likewise, 
45 one block of a current frame is composed of (16 x 16) 
pixels. The value of each pixel of the reference frame is 
denoted by P(Hr, Vr). Likewise, the value of each pixel 
of the current frame is denoted by P(Hc, Vc). The sum 
of the absolute values of the difference values between 
50 upper contour pixels P(Hr, Vr) to P(Hr + 15, Vr) of the 
block of the reference frame and upper contour pixels 
P(Hc. Vc) to P(Hc + 15. Vc) of the relevant block of the 
current frame is obtained as a residual. The sum of the 
absolute values of the difference values between left 
55 contour pixels P(Hr, Vr + 1) to P(Hr. Vr + 14) of the block 
of the reference frame and left contour pixels P(Hc. Vc 
+ 1) to P(Hc. Vc + 1 4) of the relevant block of the current 
frame is obtained as a residual. The sum of the absolute 
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values of the difference values between right contour 
pixels P(Hr + 15, Vr + 1) to P(Hr + 15. Vr + 14) of the 
block of the reference frame and right contour pixels 
P(Hc + 15. Vc + 1) of the relevant block of the current 
frame is calculated as a residual. The sum of the abso- 5 
lute values of the cfifference values between lower con- 
tour pixels P(Hr, Vr + 15) to P(Hr + 15. Vr + 15) of the 
Node cf the reference frame and lower contour pixels 
P(Hc. Vc + 15) to P(Hc + 15. Vc + 15) of the relevant 
block of the current frame is obtained as a contour. w 
[0187] Fig. 26 is a flow chart showing a process for 
obtaining the sum of the absolute values of the differ- 
ence values between contour pixels of a block of the 
current frame and contour pixels of the relevant block of 
a reference frame so as to obtain a residual. is 
[0188] Referring to Fig. 26, the value of the cumulation 
value AD is initialized to "0" (at step S221). Thereafter, 
the horizontal position He and the vertical position Vc of 
a pixel of the current frame and the horizontal position 
Hr and the vertical position Vr of a pixel of the reference so 
frame are initialized (at step S222). The offset 0 is initial- 
ized to (at step S223). 

[0189] The absolute value of the difference value 
between the value of the pixel P(Hr + O, Vr) of the refer- 
ence frame and the value of the pixel P(Hc + O, Vc) of 2s 
the current frame is obtained as a cumulation value AD 
(at step S224). Thereafter, the offset O is incremented 
(at step S225). Thereafter, it is determined whether or 
not the offset O is less than 16 (at step S226). When the 
determined result at step S226 is Yes (namely, the offset 30 
O is less than 16). the flow returns to step S224. 
[0190] In a loop from step S224 to step S226, the sum 
of the absolute value of the difference values between 
the upper contour pixels P(Hr, Vr) to P(Hr + 15. Vr) of 
the block of the reference frame and the upper contour 35 
pixels P(Hc, Vc) to P(Hc + 15. Vc) of the relevant block 
of the current frame is obtained. 
[0191] In other words, since the offset O has been ini- 
tialized to "0" at step S223. the absolute value of the cfif- 
ference value between the value of the upper left pixel 40 
P(Hr. Vr) of the block of the reference frame and the 
value of the upper left pixel P(Hc, Vc) of the relevant 
block of the current frame is obtained as the cumulation 
value AD. 

[0192] Thereafter, the offset O is incremented at step 45 
S225. Thus, the absolute value of the difference value 
between the value of the pixel P(Hr + 1, Vr) of the block 
of the reference frame and the value of the pixel P(Hc + 
1. Vc) of the relevant block of the current frame is 
obtained and added to the cumulation value AD. The so 
steps in the loop are repeated until the offset O 
becomes "15". Thus, the sum of the absolute values of 
the difference values between the upper contour pixels 
P(Hr, Vr) to P(Hr + 15. Vr) of the block of the reference 
frame and the upper contour pixels P(Hc. Vc) to P(Hc + ss 
15, Vc) of the relevant block of the current frame is 
obtained. 

[0193] Thus, in the loop from step S224 to S226. the 



sum of the absolute values of the difference values 
between the upper contour pixels of the block of the cur- 
rent frame and the upper contour pixels of the relevant 
block of the reference frame is obtained. Thereafter it is 
determined whether or not the offset O is "16" at step 
S226. When the determined result at step S226 is No 
(namely, the offset O is "16"). since the right end of the 
block has been detected, the offset O is initialized to "1 " 
(at step S227). 

[0194] Thereafter, the difference value between the 
value of the pixel P(Hr, Vr + O) of the block of the refer- 
ence frame and the value of the pixel P(Hc, Vc + O) of 
the relevant block of the current frame is obtained. The 
difference value between the value of the pixel P(Hr + 
15, Vr + O) of the block of the reference frame and the 
value of the pixel P(Hc + 15, Vc + O) of the relevant 
block of the current frame is obtained. The sum of these 
absolute values is obtained as the cumulation value AD 
(at step S228). Thereafter, the offset O is incremented 
(at step S229). Thereafter, it is determined whether or 
not the offset O is less than "15" (at step S230). When 
the determined result at step S230 is Yes (namely, the 
offset O is less than "15"). the flow returns to step S228. 
[0195] In the loop from step S228 to S230, the sum of 
the absolute values of the difference values between 
the left contour pixels P(Hr, Vr + 1) to P(Hr, Vr + 14) of 
the block of the reference frame and the left contour pix- 
els P(Hc. Vc + 1) to P(Hc. Vc + 1 4) of the relevant block 
of the current frame is obtained. In addition, the sum of 
the absolute values of the difference values between 
the right contour pixels P(Hr + 15. Vr + 1) of the block of 
the reference frame and the right contour pixels P(Hc + 
15. Vc + 1) to P(Hc + 15. Vc + 14) of the relevant block 
of the current frame is obtained. 
[0196] Thereafter, it is determined whether or not the 
offset O is "15" at step S230. When the determined 
result at step S230 is No (namely, the offset O is "1 5"). 
since the lower end of the block has been detected, the 
offset O is initialized to "0" (at step S231). 
[01 97] Next, the absolute value of the difference value 
between the pixel P(Hr + O, Vr + 1 5) of the block of the 
reference frame and the pixel P(Hc + O, Vc+ 15) of the 
relevant block of the current frame is obtained as the 
cumulation value AD (at step S232). Thereafter, the off- 
set O is incremented (at step S233). Thereafter, it is 
determined whether or not the offset O is less than "1 6" 
(at step S234). When the determined result at step 
S234 is Yes (namely, the offset O is less than "16"), the 
flow returns to step S232 

[0198] In the loop from step S232 to S234. the sum of 
the absolute values of the difference values between 
the lower contour pixels P(Hr, Vr + 15) to P(Hr + 15. Vr 
+ 15) of the block of the reference frame and the lower 
contour pixels P(Hc. Vc + 15) to P(Hc + 15. Vc + 15) of 
the relevant block of the current frame is obtained. 
When the determined result at step S234 is No (namely, 
the offset O is "16"), since the right end of the block has 
been detected, the process is completed. 
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[0199] In the loop from steps S224 to S226, the sum 
of the absolute values of the (Sfference values between 
the upper contour pixels of the block of the current 
frame and the upper contour pixels of the relevant block 
of the reference frame is obtained. In the loop from 
steps S228 to S230, the sum of the absolute values of 
the deference values between the left contour pixels of 
the block of the current frame and the left contour pixels 
of the relevant block of the reference frame is obtained. 
In addition, the sum of the absolute values of the differ- 
ence values between the right contour pixels of the 
block of the current frame and the right contour pixels of 
the relevant block of the reference frame is obtained. In 
the loop from steps S232 to S234 f the sum of the abso- 
lute values of the difference values between the lower 
contour pixels of the block of the current frame and the 
lower contour pixels of the relevant block of the refer- 
ence frame is obtained. Thus, the sum of the absolute 
values of the rffference values between the four-side 
contour pixels of the block of the current frame and the 
four-side contour pixels of the relevant block of the refer- 
ence frame is obtained. 

[0200] Thus, when the sum of the absolute values of 
the difference values between the contour pixels of a 
block of the current frame and the contour pixels of the 
relevant block of the reference frame is obtained, the 
number of calculating steps for obtaining a residual can 
be remarkably decreased. Consequently, the block 
matching process can be performed at high speed. In 
other words, when the size of a block is (16 x 16) pixels, 
to calculate all pixels of one block. 256 subtractions are 
required. In contrast, to calculate contour pixels, only 60 
subtractions are required. In addition, since the contour 
pixels are not thinned out, a moving vector can be 
obtained in the accuracy of one pixel. 
[0201] Next, a picture encoding apparatus according 
to a fifth embodiment of the present invention will be 
descrbed. 

[0202] Fig. 27 shows the structure of the picture 
encoding apparatus 401 according to the fifth embodi- 
ment of the present invention. Referring to Fig. 27, the 
picture encoding apparatus (denoted by 401) has a 
frame buffer 202, a motion detecting portion 203. a 
residual information generating portion 204, a global 
vector detecting portion 205, and a controlling portion 
206. Picture data is input to the frame buffer 202. The 
motion detecting portion 203 detects a motion compo- 
nent of picture data stored in the frame buffer 202. The 
residual information generating portion 204 generates 
motion residual information AD. The global vector 
detecting portion 205 detects a moving vector of the 
entire picture. The controlling portion 206 outputs 
parameters and so forth for an encoding process to indi- 
vidual portions of the apparatus. 
[0203] The frame buffer 202 inputs picture data from i 
an external apparatus and stores picture data frame by 
frame. The frame buffer 202 outputs picture data to the 
motion detecting portion 203, the residual information 



generating portion 204, the global vector detecting por- 
tion 205, and a calculating portion 207 at a predeter- 
mined timing under the control of the controlling portion 
206. 

[0204] The global vector detecting portion 205 sam- 
ples picture data (received from the frame buffer 202) as 
a plurality of macro blocks and detects a moving vector 
of the entire macro blocks. In other words, since the glo- 
bal vector detecting portion 205 obtains a moving vector 
>o of all the macro blocks, the global vector detecting por- 
tion 205 obtains a moving vector of the entire picture 
(namely, a global vector) and supplies the detected glo- 
bal vector to the motion detecting portion 203. 
[0205] In reality, as shown in Fig. 28, the global vector 
is detecting portion 205 extracts a plurality of macro 
blocks at different positions of one picture and detects 
one moving vector of the extracted macro blocks. At this 
point, the global vector detecting portion 205 applies a 
moving vector of each of the extracted macro blocks to 
20 an evaluation function so as to obtain the global vector. 
The global vector detecting portion 205 uses as an eval- 
uation function a function expression for calculating the 
average of moving vectors of extracted macro blocks so 
as to obtain the global vector. 
25 [0206] Alternatively, the global vector detecting por- 
tion 205 may extract a plurality of adjacent macro blocks 
so as to obtain a global vector. In other words, the global 
vector detecting portion 205 may obtain a global vector 
with each macro block of (16 x 16) pixels or with each 
30 small area of for example (32 x 32) pixels. 

[0207] As another alternative method, as shown in 
Fig. 29, the global vector detecting portion 205 may 
obtain global vectors for areas A, B, and C into which 
one screen is vertically divided. Thus, in the case that 
35 the area A is a picture of a mountain that has been pho- 
tographed as a far-distance picture and the area C is a 
picture of a flower that has been photographed as a 
near-distance picture and that the area A and the area 
C have been panned, even if one screen has two pic- 
40 tures that move each other, global vectors for individual 
areas can be obtained. Each area may overlap with 
each other. 

[0208] The motion detecting portion 203 detects a 
moving vector MV of each macro block (composed of 16 

45 x 16 pixels) of picture data stored in the frame buffer 
202. The motion detecting portion 203 pattern-matches 
a macro block of a reference frame with a macro block 
that is read from the frame buffer 202 and detects a 
moving vector MV. The motion detecting portion 203 

so supplies the detected moving vector MV to the residual 
information generating portion 204 and the controlling 
portion 206. At this point, the motion detecting portion 
203 generates a moving vector MV with the global vec- 
tor received from the global vector detecting portion 

is 205. In other words, when the motion detecting portion 
203 pattern-matches each macro block in a predeter- 
mined search area, the motion detecting portion 203 
varies each macro block in the search area with an off- 
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set of the global vector and obtains a moving vector MV 
The motion detecting portion 203 varies the center posi- 
tion of the search area corresponding to the global vec- 
tor so as to pattern-match each macro Week. 
[0209] The residual information generating portion 
204 receives the moving vector MV from the motion 
detecting portion 203. In addition, the residual informa- 
tion generating portion 204 receives each macro block 
of picture data from the frame buffer 202. With the mov- 
ing vector MV and picture data, the residual information 
generating portion 204 obtains the sum of the absolute 
values of cfifference values between moving compo- 
nents as residual information AO and supplies the resid- 
ual information AD to the controlling portion 206. 
[021 OJ The controlling portion 206 determines a 
macro block type for the encoding process with the 
moving vector MV received from the motion detecting 
portion 203 and the motion residual information AD 
received from the residual information generating por- 
tion 204. The controlling portion 206 determines 
whether the current macro block is an inter-macro block 
or an intra-macro block corresponding to for example 
the picture type. The inter-macro block is a macro block 
that is motion-cornpensated with a moving vector MV 
and encoded with a residual. In contrast, the intra- 
macro block is a macro block that is simply encoded 
without moving components. 

[0211] The controlling portion 206 generates control 
information that causes switches 217 and 218 to oper- 
ate corresponding to the determined macro block type. 
In addition, the controlling portion 206 supplies the mov- 
ing vector MV received from the motion detecting por- 
tion 203 to the motion compensating portion 216. 
[0212] The picture encoding apparatus 201 also has 
a calculating portion 207, a DCT process portion 208. a 
Quantizing process portion 209, a variable length code 
encoefng portion 210. and a buffer 211 The calculating 
portion 207 receives a picture signal from the frame 
buffer 202. The DCT process portion 208 performs a 
DCT (Discrete Cosine Transform) process for picture 
data. The quantizing process portion 209 quantizes a 
DCT coefficient received from the DCT process portion 
208. The variable length code encoding portion 210 
compresses a DCT coefficient received from the quan- 
tizing process portion 209 with variable length code. 
The buffer 211 stores picture data received from the 
variable length code encoding portion 210. 
[021 3] The DCT process portion 208 performs a two- 
dimensional DCT process for each macro block of (8 x 
8) pixels of picture data received from the calculating 
portion 207. The DCT process portion 208 supplies a 
DCT coefficient to the quantizing process portion 209. 
[0214] The quantizing process portion 209 quantizes 
a DCT coefficient received from the DCT process por- 
tion 208 with a quantizing scale that varies correspond- 
ing to each macro block. The quantizing process portion 
209 supplies the quantized DCT coefficient to the varia- 
ble length code encoding portion 210 and an inversely 



quantizing process portion 212. 
[0215] The variable length code encoding portion 210 
receives a DCT coefficient from the quantizing process 
portion 209 and a moving vector MV from the controlBng 

5 portion 206. With such information, the variable length 
code encoding portion 210 performs an encoding proc- 
ess. The variable length code encoding portion 210 per- 
forms an encoolng process with variable length code 
corresponding to MPEG syntax and performs a header 

10 process, a code generating process, and so forth so as 
to generate picture data. The variable length code 
encoding portion 210 supplies the encoded picture data 
to the buffer 211. 

[0216] The buffer 21 1 stores picture data received 
is from the variable length code encoding portion 210 and 
outputs the picture data as a bit stream at a predeter- 
mined timing under the control of the controlling portion 
206. 

[021 7] In addition, the picture encoding apparatus 201 

20 also has an inversely quantizing process portion 212, 
an inversely DCT process portion 213, a calculating unit 
214, a buffer 215. and a motion compensating portion 
216. The inversely quantizing process portion 212 
inversely quantizes a DCT coefficient received from the 

25 quantizing process portion 209. The inversely DCT 
process portion 213 inversely performs a DCT process 
for a DCT coefficient received from the inversely quan- 
tizing process portion 212. The calculating unit 214 
receives picture data from the inversely DCT process 

30 portion 213. The buffer 215 stores picture data. The 
motion compensating portion 216 melton-compensates 
picture data received from the buffer 215. 
[0218] The inversely quantizing process portion 212 
inversely quantizes a DCT coefficient received from the 

36 quantizing process portion 209. The inversely quantiz- 
ing process portion 212 inversely quantizes data 
received from the quantizing process portion 209 with 
the quantizing scale thereof and supplies the resultant 
DCT coefficient to the inversely DCT process portion 

40 213. 

[0219] The inversely DCT process portion 213 
inversely performs a DCT process for a DCT coefficient 
received from the inversely quantizing process portion 
212 and supplies the resultant DCT coefficient to the 

45 calculating unit 214. The calculating unit 214 receives 
picture data that has been processed in the inversely 
DCT process portion 213. In addition, the calculating 
unit 214 receives picture data (that has been motion- 
compensated) through the switch 217. The calculating 

so unit 214 adds the motion-compensated picture data and 
the picture data received from the inversely DCT proc- 
ess portion 213 and supplies the resultant data to the 
buffer 215. 

[0220] The buffer 215 receives each macro block of 
55 picture data from the calculating unit 21 4 and stores the 
picture data. When the motion compensating portion 
216 motion-compensates picture data, predictive pic- 
ture data is read from the buffer 215. 
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[02211 The motion compensating portion 216 reads 
each macro block of predictive picture data from the 
buffer 215 corresponding to a moving vector MV. 
[0222] When the picture encoding apparatus 201 gen- 
erates an I (Intra) picture, each macro block of picture 
data stored in the frame buffer 202 is supplied to the 
DCT process portion 208 and the quantizing process 
portion 209 through the calculating unit 207. The DCT 
process portion 208 performs the OCT process for each 
macro block of the picture data. The quantizing process 
portion 209 quantizes the picture data received from the 
DCT process portion 208. The variable length code 
encocfing portion 210 encodes the picture data received 
from the quantizing process portion 209 with variable 
length code and outputs the resultant data as a bit 
stream through the buffer 21 1. The resultant signal that 
has been processed by the quantizing process portion 
209 and the variable length code encoding portion 210 
is restored to picture data by the inversely quantizing 
process portion 21 2 and the inversely DCT process por- 
tion 213 and temporarily stored to the buffer 215. 
[0223] When the picture encoding apparatus 201 gen- 
erates a P (predictive) picture, the motion detecting por- 
tion 203 detects a moving component of picture data 
stored in the frame buffer 202 so as to generate a mov- 
ing vector MV. In addition, the residual information gen- 
erating portion 204 generates residual information AD. 
The moving vector MV is supplied to the motion com- 
pensating portion 216 through the controlling portion 
206. The motion compensating portion 216 motion- 
compensates picture data stored in the buffer 215 
(when the I picture is generated, the picture data is 
stored to the buffer 215). Thus, the motion compensat- 
ing portion 216 generates predictive data. The motion 
compensating portion 216 motion-compensates each 
macro block. The switches 21 7 and 21 8 are closed cor- 
responding to a switch control signal received from the 
controlling portion 206. The calculating unit 207 sub- 
tracts the predictive picture data received from the 
motion compensating portion 216 from the picture data 
stored in the frame buffer 202. The DCT process portion 
208 and the quantizing process portion 209 perform the 
abcve-descrfoed processes. The variable length code 
encoding portion 210 encodes picture data and outputs 
the resultant data as a bit stream through the buffer 21 1 . 
[0224] When the picture encoding apparatus 201 gen- 
erates a B (Bidirectionally predictive) picture, the motion 
compensating portion 216 motion-compensates picture 
data of the preceding frame stored in the buffer 215 and 
picture data of the next frame so as to generate predic- 
tive picture data. The calculating unit 207 subtracts the 
predictive picture data from the picture data stored in 
the frame buffer 202 The DCT process portion 208 and 
the quantizing process portion 209 perform the above- 
descrbed processes. The variable length code encod- 
ing portion 210 encodes the data received from the cal- 
culating unit 207 with variable length code and outputs 
the resultant data as a bit stream through the buffer 211. 



[0225] Rg. 30 is a flow chart showing a process for 
detecting a moving vector MV. The process is per- 
formed by the picture encoding apparatus 201. 
[0226] Referring to Fig. 30. at step S301 , picture data 
s of one frame is input to the frame buffer202. Intheproc- 
ess shown in Fig. 30. at steps S302 to S304, a global 
vector is detected. At step S305. the motion detecting 
portion 203 generate a moving vector MV of each 
macro block. 

w [0227] At step S302, the global vector detecting por- 
tion 205 inputs picture data of each frame stored in the 
frame buffer 202 and extracts a plurality of macro blocks 
from the picture data as shown in Fig. 28. At step S302, 
as shown in Fig. 29, one screen may be divided into a 
is plurality of areas and a plurality of macro blocks may be 
extracted therefrom. 

[0228] At step S303. the global vector detecting por- 
tion 205 detects a moving vector of each macro block 
detected at step S302. 
20 [0229] At step S304, the global vector detecting por- 
tion 205 applies a moving vector of each macro block to 
an evaluation function so as to generate a global vector. 
The global vector detecting portion 205 calculates the 
average of moving vectors of macro blocks and gener- 
is ates a global vector. 

[°230] At step S305, the motion detecting portion 203 
receives each macro block of picture data, pattern- 
matches each macro block with the global vector 
detected at step S304, and detects a moving vector of 
30 each macro block. At this point, the motion detecting 
portion 203 varies the center position of a search area 
corresponding to the global vector and pattern-matches 
each macro block. 

[0231] At step S306. themotion detecting portion 203 
35 detects a moving vector MV of each macro block corre- 
sponding to the detected result at step S305 and sup- 
plies the moving vector VM of each macro block to the 
residual information generating portion 204 and the 
controlling portion 206. 
40 [0232] In the picture encoding apparatus 201. before 
the motion detecting portion 203 generates a moving 
vector MV of each macro block, the global vector detect- 
ing portion 205 detects a global vector that represents 
one moving vector of the entire picture. Thus, the 
45 motion detecting portion 203 does not need to detect a 
moving vector MV of each macro block in a wide area. 
Consequently, the process for detecting a moving vector 
MV can be performed with a reduced number of calcu- 
lating steps. In other words, in the picture encoding 
so apparatus 201. even if a picture that is moving is 
panned, it is not necessary to cause the global vector 
detecting portion 205 to obtain a global vector of the 
entire picture and to detect a moving vector of each 
macro block in a wide search area, 
ss [0233] In addition, using the picture encoding appara- 
tus 201, even if a picture moves at high speed on the 
entire screen, a moving vector of each macro block can 
be easily detected. 
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[0234] Moreover, using the picture encoding appara- 
tus 201, since one screen is divided into a plurality of 
areas. The global vector detecting portion 5 calculates a 
global vector of each area. Thus, even if a picture 
largely moves on the screen, a moving vector MV can 5 
be effectively detected. 

[0235] Next, a sixth ernbodiment of the present inven- 
tion will be described. 

[0236] Rg. 31 is a block diagram showing the struc- 
ture of a picture encoding apparatus according to the w 
sixth entxxfiment of the present invention. 
[0237] Fig. 31 shews the structure of the picture 
encoring apparatus according to the sixth embodiment 
of the present invention. Referring to Fig. 31 , the picture 
encoring apparatus (denoted by 301) has a frame is 
buffer 302, a motion detecting portion 303, a residual 
information generating portion 304, and a controlling 
portion 305. Picture data is input to the frame buffer 
302. The motion detecting portion 303 detects a motion 
component of picture data stored in the frame buffer 20 
302. The residual information generating portion 304 
generates motion residual information AD. The control- 
ling portion 306 outputs parameters and so forth for an 
encoding process to individual portions of the appara- 
tus. 25 
[0238] The frame buffer 302 inputs picture data from 
an external apparatus and stores picture data frame by 
frame. The frame buffer 302 outputs picture data to the 
motion detecting portion 303. the residual information 
generating portion 304, and a calculating portion 307 at 30 
a predetermined timing under the control of the control- 
ling portion 305. 

[0239] The motion detecting portion 303 detects a 
moving vector MV of each macro block (composed of 16 
x 16 pixels) of picture data stored in the frame buffer 35 
302. The motion detecting portion 303 pattern-matches 
a macro block of a reference frame with a macro block 
that is read from the frame buffer 302 and detects a 
moving vector MV. The motion detecting portion 303 
supplies the detected moving vector MV to the residual 40 
information generating portion 304 and the controlling 
portion 305. 

[0240] The residual information generating portion 
304 receives the moving vector MV from the motion 
detecting portion 303. In addition, the residual informa- 45 
tion generating portion 304 receives each macro block 
of picture data from the frame buffer 302. With the mov- 
ing vector MV and picture data, the residual information 
generating portion 304 obtains the sum of the absolute 
values of cfifference values between moving compo- so 
nerrts as residual information AD and supplies the resid- 
ual information AD to the controlling portion 305 and a 
skip controlling portion 310. 

[0241] The controlling portion 305 determines a 
macro block type for the encoding process with the ss 
moving vector MV received from the motion detecting 
portion 303 and the motion residual information AD 
received from the residual information generating por- 



tion 304. The controlling portion 305 determines 
whether the current macro block is an inter-macro block 
or an intra -macro block corresponding to for example 
the picture type. The inter-macro block is a macro block 
that is motion -compensated with a moving vector MV 
and encoded with a residual. In contrast, the mtra- 
macro block is a macro block that is simply encoded 
without moving components. 
[0242] The controlling portion 305 generates control 
information that causes switches 317 and 318 to oper- 
ate corresponding to the determined macro block type. 
In addition, the controlling portion 305 supplies the mov- 
ing vector MV received from the motion detecting por- 
tion 303 to the motion compensating portion 316. 
[0243] The picture encoding apparatus 301 also has 
a calculating portion 306, a DCT process portion 307, a 
quantizing process portion 308, a variable length code 
encoding portion 309, the above-mentioned skip con- 
trolling portion 310, and a buffer 311. The calculating 
portion 306 receives a picture signal from the frame 
buffer 302. The DCT process portion 307 performs a 
DCT (Discrete Cosine Transform) process for picture 
data. The quantizing process portion 308 quantizes a 
DCT coefficient received from the DCT process portion 
307. The variable length code encoding portion 309 
compresses a DCT coefficient received from the quan- 
tizing process portion 308 with variable length code. 
The skip controlling portion 310 controls the DCT proc- 
ess portion 307, the quantizing process portion 308, the 
variable length code encoding portion 309, and so forth. 
The buffer 311 stores picture data that has been 
encoded. 

[0244] The DCT process portion 307 performs a two- 
dimensional DCT process for each macro block of (8 x 
8) pixels of picture data received from the calculating 
portion 306. The DCT process portion 307 supplies a 
DCT coefficient to the quantizing process portion 308. 
[0245] The quantizing process portion 308 quantizes 
a DCT coefficient received from the DCT process por- 
tion 307 with a quantizing scale that varies correspond- 
ing to each macro block. The quantizing process portion 
308 supplies the quantized DCT coefficient to the varia- 
ble length code encoding portion 309 and an inversely 
quantizing process portion 312. In addition to the quan- 
tizing process, the quantizing process portion 308 gen- 
erates a CBP (Coded Block Pattern). When the 
quantizing process portion 308 generates the CBP, it 
supplies information that represents the CBP to the var- 
iable length code encoding portion 309. 
[0246] The skip controlling portion 310 generates a 
skjp control signal that causes the DCT process portion 
307 and the quantizing process portion 308 to skip the 
DCT process and the quantizing process corresponding 
to the motion residual information received from the 
residual information generating portion 304. The skip 
controlling portion 310 receives motion residual infor- 
mation AD from the motion detecting portion 303, pre- 
dicts the value of the CBP with the motion residual 
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information AD, and sets the DCT coefficient to "0" cor- 
responding to the value of the CBR When the skip con- 
trolling portion 310 sets the DCT coefficient to "0", the 
skip controlling portion 31 0 supplies the skip control sig- 
nal to the motion compensating portion 316. the DCT 
process portion 307, the quantizing process portion 
308, and the variable length code encoding portion 309. 
Thus, when the skip controlKng portion 310 sets the 
value of the CBP (namely, the DCT coefficient) to IT it 
causes such portions to skip their processes. 
[0247] When the skp controlling portion 310 sets the 
DCT coefficient to "0". the skip controlling portion 310 
compares the motion residual information AD received 
from the residual information generating portion 304 
with a predetermined value. The predetermined value is 
designated by for example the user. In other words, 
when the motion residual information AD is smaller than 
the predetermined value, the skip controlling portion 
310 determines that the value of the CBP is small and 
supplies a skip control signal (that substitutes "0" to the 
DCT coefficient) to the above-described portions. In 
contrast, when the motion residual information AD is not 
smaller than the predetermined value, the skip control- 
ling portion 310 does not generate the skip control sig- 
nal. 

[0248] Alternatively, the skip controlling portion 310 
may determine the predetermined value with informa- 
tion obtained in the encoding process (the information is 
such as the bit rate of the variable length code encoding 
process of the variable length code encoding portion 

309 and the quantizing scale of the quantizing process 
of the quantizing process portion 308) and compares 
the predetermined value with the motion residual infor- 
mation AD. At this point, the skip controlling portion 310 
compares the motion residual information for each 
macro block with the predetermined value and gener- 
ates the skip control signal corresponding to the com- 
pared result 

[0249] As another alternative method, the skip control- 
ling portion 310 may use the mean value MAD of the 
motion residual information AD of each macro block 
instead of the motion residual information AD. In this 
case, the mean value MAD is generated by the motion 
compensating portion 316. The skip controlling portion 

310 receives the mean value MAD from the motion 
compensating portion 316 and sets the DCT coefficient 
to "0" corresponding to the mean value MAD. The detail 
operation of the skip controlling portion 310 will be 
descrbed later. 

[0250] The variable length code encocfing portion 309 
receives a DCT coefficient from the quantizing process 
portion 308 and a moving vector MV from the controlling 
portion 305. With such information, the variable length 
code encoding portion 309 performs an encoding proc- 
ess. The variable length code encocfing portion 309 per- 
forms an encoding process with variable length code 
corresponding to MPEG syntax and performs a header 
process, a code generating process, and so forth so as 



to generate picture data. The variable length code 
encoding portion 309 supplies the encoded picture data 
to the buffer 311. 

[0251 ] The variable length code encoding portion 309 
5 receives information that represents that the value of 
the CBP is "0* from the quantizing process portion 308. 
When there is no moving vector MV. the variable length 
code encoding portion 309 may skip a macro block cor- 
responding to the macro block type. 
w [0252] The buffer 311 stores picture data received 
from the variable length code encoding portion 309 and 
outputs the picture data as a bit stream at a predeter- 
mined timing under the control of the controlling portion 
305. 

is [0253] In addition, the picture encoding apparatus 301 
also has an inversely quantizing process portion 312, 
an inversely DCT process portion 313. a calculating unit 
314, a buffer 315, and a motion compensating portion 
316. The inversely quantizing process portion 312 

20 inversely quantizes a DCT coefficient received from the 
quantizing process portion 308. The inversely DCT 
process portion 313 inversely performs a DCT process 
for a DCT coefficient received from the inversely quan- 
tizing process portion 312. The calculating unit 314 

25 receives picture data from the inversely DCT process 
portion 313. The buffer 315 stores picture data. The 
motion compensating portion 316 motion-compensates 
picture data received from the buffer 315. 
[0254] The inversely quantizing process portion 312 

30 inversely quantizes a DCT coefficient received from the 
quantizing process portion 308. The inversely quantiz- 
ing process portion 312 inversely quantizes data 
received from the quantizing process portion 308 with 
the quantizing scale thereof and supplies the resultant 

35 DCT coefficient to the inversely DCT process portion 
313. 

[0255] The inversely DCT process portion 313 
inversely performs a DCT process for a DCT coefficient 
received from the inversely quantizing process portion 

40 312 and supplies the resultant DCT coefficient to the 
calculating unit 314. The calculating unit 314 receives 
picture data that has been processed in the inversely 
DCT process portion 313. In addition, the calculating 
unit 314 receives picture data (that has been motion- 

45 compensated) through the switch 317. The calculating 
unit 314 adds the motion-compensated picture data and 
the picture data received from the inversely DCT proc- 
ess portion 313 and supplies the resultant data to the 
buffer 315. 

so [0256] The buffer 315 receives picture data from the 
calculating unit 314 and stores the picture data. When 
the motion compensating portion 316 motion-compen- 
sates picture data, predictive picture data is read from 
the buffer 315. 

55 [0257] The motion compensating portion 316 reads 
each macro block of predictive picture data from the 
buffer 315 corresponding to a moving vector MV. The 
motion compensating portion 316 supplies the motion 
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vector MV received from the controlling portion 305 to 
the calculating portion 306 corresponding to the predic- 
tive picture data. 

[0258] When the picture encoding apparatus 301 gen- 
erates an I (Intra) picture, each macro block of picture 
data stored in the frame buffer 302 is supplied to the 
DCT process portion 307 and the quantizing process 
portion 308 through the calculating unit 306. The DCT 
process portion 307 performs the DCT process for each 
macro block of the picture data. The quantizing process 
portion 308 quantizes the picture data received from the 
DCT process portion 307. The variable length code 
encodng portion 309 encodes the picture data received 
from the quantizing process portion 308 with variable 
length code and outputs the resultant data as a bit 
stream through the buffer 31 1 . The resultant signal that 
has been processed by the quantizing process portion 
308 and the variable length code encodng portion 309 
is restored to picture data by the inversely quantizing 
process portion 31 2 and the inversely DCT process por- 
tion 313 and temporarily stored to the buffer 315. 
[0259] When the picture encoding apparatus 301 gen- 
erates a P (predictive) picture, the motion detecting por- 
tion 303 detects a moving corrponent of picture data 
stored in the frame buffer 302 so as to generate a mov- 
ing vector MV. In addition, the residual information gen- 
erating portion 304 generates residual information AD. 
The moving vector MV is supplied to the motion com- 
pensating portion 316 through the controlling portion 
305. The motion compensating portion 316 motion- 
compensates picture data stored in the buffer 315 
(when the I picture is generated, the picture data is 
stored to the buffer 315). Thus, the motion compensat- 
ing portion 316 generates predictive data The motion 
compensating portion 316 motion-compensates each 
macro block. The switches 317 and 318 are closed cor- 
responding to a switch control signal received from the 
controlling portion 305. The calculating unit 306 sub- 
tracts the predictive picture data received from the 
motion compensating portion 316 from the picture data 
stored in the frame buffer 302. The DCT process portion 
307 and the quantizing process portion 308 perform the 
above-descrfoed processes. The variable length code 
encoding portion 309 encodes picture data and outputs 
the resultant data as a bit stream through the buffer 31 1 . 
[0260] When the picture encoding apparatus 301 gen- 
erates a B (Bkfirectionally predictive) picture, the motion 
compensating portion 316 motion -compensates picture 
data of the preceding frame stored in the buffer 315 and 
picture data of the next frame so as to generate predic- 
tive picture data. The calculating unit 306 subtracts the 
predictive picture data from the picture data stored in 
the frame buffer 302. The DCT process portion 307 and 
the quantizing process portion 308 perform the above- 
described processes. The variable length code encod- 
ing portion 309 encodes the data received from the cal- 
culating unit 306 with variable length code and outputs 
the resultant data as a bit stream through the buffer 31 1 . 



[0261] Rg. 32 is a flow chart showing an encoding 
process of the picture encoding apparatus 301. In the 
flow chart shown in Rg. 32, a moving vector MV is 
detected from picture data stored in the frame buffer 
5 302. A P picture or a B picture is generated correspond- 
ing to the detected moving vector MV. 
[0262] At step S401, picture data of one frame is irput 
to the frame buffer 302. 

[0263] At step S402, the motion detecting portion 303 
w detects the motion of the picture data stored in the 
frame buffer 302 and detects the motion as a moving 
vector MV. The residual information generating portion 
304 generates motion residual information AD with the 
moving vector MV. The moving vector MV and the 
is motion residual information AD are supplied to the con- 
trolling portion 305 and the skp controlling portion 310, 
respectively. 

[0264] At step S403, the skip controlling portion 310 
compares the motion residual information AD received 

w from the residual information generating portion 304 
with a predetermined value. When the determined 
result at step S403 is Mo (namely, the motion residual 
information AD is larger than the predetermined value), 
the flow advances to step S404. In contrast, when the 

!5 determined result at step S403 is Yes (namely, the 
motion residual information AD is not larger than the 
predetermined value), the flow advances to step S407. 
[0265] At step S404. with the motion vector MV 
received from the controlling portion 305. the predictive 

c picture data is generated and supplied to the calculating 
portion 306. Corresponding to the calculated result of 
the calculating unit 306, the motion compensating por- 
tion 316 compensates the motion of the picture data. 
[0266] At step S405, the calculating unit 306 subtracts 

s the predictive picture data that has been motion-com- 
pensated at step S404 from the picture data received 
from the frame buffer 302. The DCT process portion 

307 performs the DCT process for the picture data 
received from the calculating unit 306. 

o [0267] At step S406, the quantizing process portion 

308 cjjantizes the DCT coefficient generated by the 
DCT process portion 307 at step S405. 

[0268] In contrast, when the determined result at step 
S403 is Yes (namely, the motion residual information AD 

5 is not larger than the predetermined value), the flow 
advances to step S407. At step S407, the skp control- 
ling portion 310 generates the skip control signal that 
causes the DCT process portion 307, the quantizing 
process portion 308, the variable length code encoding 

» portion 309, and the motion corrpensarjng portion 316 
to slop their processes and supplies the skip control sig- 
nal to these portions. In other words, picture data stored 
in the buffer 315 is supplied to the variable length code 
encoding portion 309. 

[0269] At step S408. the variable length code encod- 
ing portion 309 determines whether or not the value of 
the CBP is "0". When "0" has been set to the DCT coef- 
ficient at step S407, the variable length code encoding 
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portion 309 determines that the value of the CBP is "0". 
[0270] At step S409, the variable length code encod- 
ing portion 309 performs for example a header process 
and a variable length code generating process and out- 
puts the encoded picture data as a bit stream through 
the buffer 311. A macro block of which the value of the 
CBP is "0" determined at step S408 is data composed 
of header, MB increment, CBP. vector, and so forth 
rather than data of (16x16) pixels. In other words, when 
a macro block of which the value of the CBP is "0" is 
detected, the macro block is output as the same picture 
as the preceding picture. 

[0271] In the process of the picture encoding appara- 
tus 301 (see Fig. 32), the predetermined value and the 
motion residual information AD are compared so as to 
determine whether or not the OCT coefficient is "0". 
Alternatively, instead of the predetermined value, it can 
be determined whether or not the DCT coefficient is "0" 
corresponding to an evaluation function with a quantiz- 
ing scale received from the quantizing process portion 
308, an occupation amount of picture data stored in the 
buffer 315, a bit rate, and so forth. 
[0272] Since the picture encoding apparatus 301 has 
the skip controlling portion 310 that skips the motion 
compensating process, the DCT process, and the quan- 
tizing process corresponding to the compared result of 
which the motion residual information AD has been 
compared with the predetermined value, the process 
time necessary for the encoding process for picture 
data whose DCT coefficient f rally becomes "0" can be 
shortened. 

[0273] In addition, according to the picture encoding 
apparatus 301, the process time for the DCT process 
and the quantizing process in a real time encoder and 
so form is not strict Thus, the picture encoding appara- 
tus 301 can be easily designed and power consumption 
thereof can be reduced. 

[0274] In addition, according to the picture encoding 
apparatus 301, even if the encoding process is per- 
formed by software, the load of the process of for exam- 
ple a CPU (Central Processing Unit) can be reduced. 
[0275] According to the present invention, when a 
moving vector is obtained, a block of a reference frame 
and a block of the current frame are orthogonally trans- 
formed into frequency data. When picture data is trans- 
formed into frequency data and a residual between the 
block of the reference frame and the block of the curent 
frame is obtained, the number of calculating steps is 
remarkably decreased. Thus, the process can be per- 
formed at high speed. Consequently, the process can 
be sufficiently performed by software. 
[0276] According to the present invention, in a loop of 
a block matching calculation, the sum of the absolute 
values of the cfifference values between pixels of a block 
of the current frame and pixels of the relevant block of 
the reference frame is compared with a predetermined 
threshold value. When the sum exceeds the threshold 
value, the process is stopped. Thus, since the number 
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of calculating steps is deceased, a moving vector can 
be searched at high speed. 

[0277] The initial value of the threshold value is set 
corresponding to the value of the sum of mean discrete 

5 absolute values (MAD) and the residual AD (0, 0) at the 
origin. In the case that the threshold value is set corre- 
sponding to the sum MAD and the residual AD (0. 0) at 
the origin, when the inter-frame encoding process is 
performed, a moving vector can be securely detected. 

w In contrast, when the intra-frame encoding process is 
performed, the process is stopped. Thus, the block 
matching process can be effectively performed. 
[0278] In addition, when a moving vector is searched 
at first time, the threshold value obtained corresponding 

is to the sum MAD and the residual AD (0, 0) at the origin 
is used. As the threshold value for the block matching 
process performed at second time for the same block, 
the original threshold value or the detected sum is used 
whichever smaller. In other words, since the threshold 

20 value that is the minimum value that has been obtained 
so far is used, a moving vector can be effectively 
detected. 

[0279] As descrfoed above, according to the motion 
detecting apparatus and the motion detecting method of 

25 the present invention, a plurality of macro blocks are 
extracted from a picture. A moving vector of the 
extracted macro blocks is detected. With the detected 
moving vector, a moving vector of the entire picture is 
calculated. With the moving vector of the entire picture. 

30 a moving vector of each macro block is calculated. 
Thus, before a moving vector of each macro block is cal- 
culated, a moving vector of the entire picture can be 
obtained. Consequently, according to the motion detect- 
ing apparatus and the motion detecting method of the 

35 present invention, a moving vector of a picture that 
largely moves on the entire screen can be easily 
detected. In addition, the number of calculating steps for 
the process for detecting the motion of a picture can be 
remarkably decreased. 

40 [0280] As descrfoed above, according to the picture 
encoding apparatus and the picture encoding method of 
the present invention, a moving vector of a pixel block of 
picture data is detected and motion residual information 
thereof is generated. The motion residual information is 

45 compared with a predetermined value. A predetermined 
process necessary for an encoding process is per- 
formed for picture data. Corresponding to the deter- 
mined result, a predetermined process of a picture data 
process means is skipped. The process time for the 

so encoding process for a picture whose DCT coefficient 
f inally becomes "0" can be shortened. 
[0281] According to the present invention, when a 
moving vector is obtained by a block matching process, 
a residual is obtained with the sum of the absolute val- 

55 ues of the cfifference values between contour pixels of a 
block of a reference frame and contour pixels of the rel- 
evant block of the current frame. Thus, the number of 
calculating steps is decreased. Consequently, the proc- 
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ess can be performed at high speed. Since the sum of 
the absolute values of the difference values between all 
contour pixels of a block of the reference frame and all 
contour pixels of the relevant block of the current frame 
is obtained, a moving vector can be accurately 5 
detected. 

[0282] Although the present invention has been 
shown and descrfoed with respect to a best mode 
embodiment thereof, it should be understood by those 
skilled in the art that the foregoing and various other w 
changes, omissions, and additions in the form and 
detail thereof may be made therein without departing 
from the spirit and scope of the present invention. 

Claims 15 

1 . A moving vector calculating method, comprising the 
steps of: 

(a) extracting a block from a reference picture 20 
corresponding to a block of a current picture to 

be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 25 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 30 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
moving vector; 

(d) orthogonally transforming pixel data of a 
block of the reference picture and pixel data of 35 
a block of the current picture; and 

(e) obtaining a residual between orthogonally 
transformed data of the block of the reference 
picture and orthogonally transformed data of 
each block of the current picture. *o 

2. The moving vector calculating method as set forth 
in claim 1, 

wherein step (d) is performed by Hadamard trans- 
forming method. 
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3. The moving vector calculating method as set forth 
in claim 1 , further comprising the steps of: 

dividing each of a block of the reference picture so 
and a block of the current picture into a plurality 
of blocks; and 

orthogonally fransforming each of the divided 
blocks. 

55 

4. A record medium on which a moving vector calcu- 
lating program has been recorded, the moving vec- 
tor calculating program causing a system that has 



the record medium to perform the steps of: 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
moving vector; 

(d) orthogonally transforming pixel data of a 
block of the reference picture and pixel data of 
a block of the current picture; and 

(e) obtaining a residual between orthogonally 
transformed data of the block of the reference 
picture and orthogonally transformed data of 
each block of the current picture. 

5. The record medium as set forth in claim 4, 
wherein step (d) is performed by Hadamard trans- 
forming method. 

6. The record metium as set forth in claim 4, further 
comprising the steps of: 

dividing each of a block of the reference picture 
and a block of the current picture into a plurality 
of blocks; and 

orthogonally transforming each of the divided 
blocks. 

7. A moving vector calculating method, comprising the 
steps of: 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
moving vector; 

(d) while calculating a residual between pixels 
of a block of the reference picture and pixels of 
a block of the current picture, comparing the 
obtained residual with a predetermined thresh- 
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old value; and 

(e) when the residual is larger than the prede- 
termined threshold value, stopping the calcula- 
tion of the moving vector; and 

(f) setting the initial value of the predetermined s 
threshold value corresponding to a characteris- 
tic of a picture. 

8. The moving vector calculating method as set forth 

in claim 7, 10 
wherein me initial value of the predetermined 
threshold value is set corresponcfing to the sum of 
the absolute values of the difference values 
between values of pixels of the same picture and 
the mean value of the pixels thereof. is 

9. The moving vector calculating method as set forth 
in claim 7. 

wherein the initial value of the predetermined 
threshold value is set corresponding to a residual at 20 
the origin. 

10. The moving vector calculating method as set forth 
in claim 7, 

wherein the initial value of the predetermined 25 
threshold value is set corresponcfing to the sum of 
the absolute values of the difference values 
between values of pixels of the same picture and 
the mean value of the pixels thereof and a residual 
at the origin. 30 

11. The moving vector calculating method as set forth 
in claim 7, 

wherein the predetermined threshold value is the 
minimum value of residuals that have been 35 
obtained so far. 

12. A record medium on which a moving vector calcu- 
lating program has been recorded, the moving vec- 
tor calculating program causing a system that has 40 
the record medium to perform the steps of: 



a block of the current picture, comparing the 
obtained residual with a predetermined thresh- 
old value; and 

(e) when the residual is larger than the prede- 
termined threshold value, stopping the calcula- 
tion of the moving vector; and 

(f) setting the initial value of the predetermined 
threshold value corresponding to a characteris- 
tic of a picture. 

13. The record medium as set forth in claim 12, 
wherein the initial value of the predetermined 
threshold value is set corresponding to the sum of 
the absolute values of the drfference values 
between values of pixels of the same picture and 
the mean value of the pixels thereof. 

14. The record medium as set forth in claim 12. 
wherein the initial value of the predetermined 
threshold value is set corresponding to a residual at 
the origin. 

15. The record medium as set forth in claim 12, 
wherein the initial value of the predetermined 
threshold value is set corresponding to the sum of 
the absolute values of the drfference values 
between values of pixels of the same picture and 
the mean value of the pixels thereof and a residual 
at the origin. 

16. The record medium as set forth in claim 12, 
wherein the predetermined threshold value is the 
minimum value of residuals that have been 
obtained so far. 

17. A motion detecting apparatus, comprising: 

extracting means for extracting a plurality of 
macro blocks from a picture; 
first motion detecting means for detecting a 
moving vector of each of the plurality of macro 
blocks extracted by said extracting means; 
motion calculating means for calculating a 
moving vector of the entire picture with moving 
vectors of individual macro blocks detected by 
said first motion detecting means; and 
second motion detecting means for calculating 
a moving vector of each macro block with the 
moving vector calculated by said motion calcu- 
lating means. 



(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 

be processed, the size of the block of the refer- 45 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- so 
ture in a predetermined search area, obtaining 

a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 55 
moving vector; 

(d) while calculating a residual between pixels 
of a block of the reference picture and pixels of 



30 



18. The motion detecting apparatus as set forth in claim 
17. 

wherein said extracting means extracts a plurality of 
adjacent macro blocks. 

19. The motion detecting apparatus as set forth in claim 
17. 
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wherein said extracting means extracts a plurality of 
macro blocks from each of areas into which the 
entire picture is divided. 

20- A motion detecting method, comprising the steps 
of: 

(a) extracting a plurality of macro blocks from a 
picture; 

(b) detecting a moving vector of each of the 
plurality of macro blocks that have been 
extracted; 

(c) calculating a moving vector of the entire pic- 
ture with moving vectors of individual macro 
blocks that have been detected; and 

(d) calculating a moving vector of each macro 
block with the moving vector that have been 
calculated. 

21. The motion detecting method as set forth in claim 
20. 

wherein step (a) is performed by extracting a plural- 
ity of adjacent macro blocks. 

22. The motion detecting method as set forth in claim 
20. 

wherein step (a) is performed by extracting a plural- 
ity of macro blocks from each of areas into which 
the entire picture is divided. 

23. A picture encoding apparatus, comprising: 

motion detecting means for detecting a moving 
vector of a predetermined pixel block of irput 
picture data and generating motion residual 35 
information; 

determining means for comparing the motion 
residual information received from said motion 
detecting means with a predetermined value 
and generating a determined result; 40 
picture data process means for performing a 
predetermined process for picture data, the 
predetermined process being required for an 
encoding process; 

encoding means tor performing the encoding 45 
process for picture data; and 
controlling means for skipping the predeter- 
mined process performed by said picture data 
process means corresponding to the deter- 
mined result of said determining means and so 
causing said encoding means to perform the 
encoding process. 

24. The picture encoding apparatus as set forth in claim 
23. 55 
wherein said motion detecting means calculates a 
mean discrete residual of each pixel block, and 
wherein said determining means compares the 



mean discrete residual with the predetermined 
value. 



25. The picture encoding apparatus as set forth in claim 
5 23, further comprising: 

value determining means for determining the 
predetermined value with information obtained 
in the encoding process, 
10 wherein said determining means generates the 

determined result with the predetermined value 
determined by said value determining means. 

26. A picture encoding method, comprising the steps 

is of: 

(a) detecting a moving vector of a predeter- 
mined pixel block of irput picture data and gen- 
erating motion residual information; 

(b) comparing the motion residual information 
with a predetermined value and generating a 
determined result; 

(c) performing a predetermined process for pic- 
ture data, the predetermined process being 
required for an encoding process; and 

(d) skipping the predetermined process corre- 
sponding to the determined result and perform- 
ing the encoding process for the picture data. 

27. The picture encoding method as set forth in claim 
26. 

wherein step (a) is performed by calculating a mean 
discrete residual of each pixel block, and 
wherein step (b) is performed by comparing the 
mean discrete residual with the predetermined 
value. 

2a The picture encoding method as set forth in claim 
26, further cornprising the step of: 

determining the predetermined value with infor- 
mation obtained in the encoding process, 
wherein step (b) is performed by generating the 
determined result with the predetermined value 
that has been determined. 

29. A moving vector calculating method, comprising the 
steps of: 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
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a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
moving vector; 5 

(d) extracting N pixels of the curerrt picture and 
N pixels of the reference picture at a time 
(where N is an integer); 

(e) storing the N pixels of the current picture 
and the N pixels of the reference picture as 10 
successive data to a memory; and 

(f) reading pixels of the block of the current pic- 
ture and pixels of the bkxk of the reference pic- 
ture as successive data from the memory so as 
to obtain a residual. 75 



30. The vector calculating method as set forth in claim 
29, 

wherein the residual is calculated with an instruc- 
tion that causes a plurality of successive data 20 
pieces to be processed at a time. 

31. The vector calculating method as set forth in claim 
29, 

wherein N pixels of the current picture and N pixels 25 
of the reference picture are extracted checkerwise 
at a time. 

32. A record medium on which a moving vector calcu- 
lating program has been recorded, the moving vec- 30 
tor calculating program causing a system that has 
the record medium to perform the steps oh 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 35 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 40 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 45 
from the reference picture so as to calculate a 
moving vector; 

(d) extracting N pixels of the curent picture and 
N pixels of the reference picture at a time 
(where N is an integer); 50 

(e) storing the N pixels of the current picture 
and the N pixels of the reference picture as 
successive data to a memory; and 

(f) reading pixels of the block of the current pic- 
ture and pixels of the block of the reference pic- 55 
ture as successive data from the memory so as 

to obtain a residual. 



56 

33. The record medium as set forth in claim 32, 

wherein the residual is calculated with an instruc- 
tion that causes a plurality of successive data 
pieces to be processed at a time 

34 The record medium as set forth in claim 32, 

wherein N pixels of the current picture and N pixels 
of the reference picture are extracted checkerwise 
at a time. 

35. A moving vector calculating method, 
comprising the steps of: 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
coarse moving vector; 

(d) while moving the block of the reference pic- 
ture in the vicinity of the coarse moving vector 
obtained at step (c), obtaining a residual 
between the block of the current picture and the 
block of the reference picture; 

(e) detecting a block with the minimum residual 
from the reference picture so as to detect a fine 
moving vector; 

(f) storing pixels of the current picture and pix- 
els of the reference picture to a first memory; 

(g) extracting N pixels of the current picture and 
N pixels of the reference picture at a time 
(where N is an integer); and 

(h) storing the N pixels of the current picture 
and the N pixels of the reference picture as 
successive data to a second memory, 
wherein step (c) is performed with the N pixels 
of the current picture and the N pixels of the ref- 
erence picture stored as successive data in the 
second memory, and 

wherein step (e) is performed with the pixels of 
the current picture and the pixels of the refer- 
ence picture stored in the first memory. 

36. The moving vector calculating method as set forth 
in claim 35, 

wherein the residual is calculated with an instruc- 
tion that causes a plurality of successive data 
pi eces to be processed at a time. 

37. The moving vector calculating method as set forth 
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in claim 35, 

wherein N pixels of the current picture and N pixels 
of the reference picture are extracted checkerwise 
at a time. 

38. A record medium on which a moving vector calcu- 
lating program has been recorded, the moving vec- 
tor calculating program causing a system that has 
the record medium to perform the steps of: 



w 



(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the is 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 

a residual between the block of the current pic- 20 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
coarse moving vector; 

(d) while moving the block of the reference pic- 25 
ture in the vicinity of the coarse moving vector 
obtained at step (c), obtaining a residual 
between the block of the current picture and the 
block of the reference picture; 

(e) detecting a block with the minimum residual 30 
from the reference picture so as to detect a fine 
moving vector; 

(f) storing pixels of the current picture and pix- 
els of the reference picture to a first memory; 

(g) extracting N pixels of the current picture and 35 
N pixels of the reference picture at a time 
(where N is an integer); and 

(h) storing the N pixels of the current picture 
and the N pixels of the reference picture as 
successive data to a second memory. 40 
wherein step (c) is performed with the N pixels 

of the current picture and the N pixels of the ref- 
erence picture stored as successive data in the 
second memory, and 

wherein step (e) is performed with the pixels of 45 
the current picture and the pixels of the refer- 
ence picture stored in the first memory. 

39. The record medium as set forth in claim 38, 

wherein the residual is calculated with an instruc- so 
tion that causes a plurality of successive data 
pieces to be processed at a time. 

40. The record medium as set forth in claim 38, 

wherein N pixels of the current picture and N pixels ss 
of the reference picture are extracted checkerwise 
at a time. 



41. A moving vector calculating method, comprising the 
steps of: 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual 
from the reference picture so as to calculate a 
moving vector; and 

(d) comparing contour pixels of the block of the 
reference picture with contour pixels of the 
block of the current picture so as to obtain a 
residual therebetween. 

42. The moving vector calculating method as set forth 
in claim 41 . 

wherein step (d) includes the steps of: 

cumulating the absolute values of the differ- 
ence values between the upper contour pixels 
of the block of the current picture and the upper 
contour pixels of the block of the reference pic- 
ture in a horizontal scanning direction so as to 
obtain the sum thereof; 

cumulating the absolute values of the differ- 
ence values between the left contour pixels of 
the block of the current picture and the left con- 
tour pixels of the block of the reference picture 
in a vertical scanning direction so as to obtain 
the sum thereof; 

cumulating the absolute values of the differ- 
ence values between the right contour pixels of 
the block of the current picture and the right 
contour pixels of the block of the reference pic- 
ture in a vertical scanning direction so as to 
obtain the sum thereof; and 
cumulating the absolute values of the differ- 
ence values between the lower contour pixels 
of the block of the current picture and the lower 
contour pixels of the block of the reference pic- 
ture in a horizontal scanning direction so as to 
obtain the sum thereof. 

43. A record medium on which a moving vector calcu- 
lating program has been recorded, the moving vec- 
tor calculating program causing a system that has 
the record medium to perform the steps of: 

(a) extracting a block from a reference picture 
corresponding to a block of a current picture to 
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be processed, the size of the block of the refer- 
ence picture being the same as the size of the 
block of the current picture, the origin of the 
block of the reference picture matching the ori- 
gin of the block of the current picture; s 

(b) while moving the block of the reference pic- 
ture in a predetermined search area, obtaining 
a residual between the block of the current pic- 
ture and the block of the reference picture; 

(c) detecting a block with the minimum residual w 
from the reference picture so as to calculate a 
moving vector; and 

(d) comparing contour pixels of the btock of the 
reference picture with contour pixels of the 
block of the current picture so as to obtain a 15 
residual therebetween. 

44. The record medium as set forth in claim 43 wherein 
step (d) includes the steps of: 

20 

cumulating the absolute values of the differ- 
ence values between the upper contour pixels 
of the block of the current picture and the upper 
contour pixels of the block of the reference pic- 
ture in a horizontal scanning direction so as to 25 
obtain the sum thereof; 

cumulating the absolute values of the differ- 
ence values between the left contour pixels of 
the block of the current picture and the left con- 
tour pixels of the block of the reference picture 30 
in a vertical scanning direction so as to obtain 
the sum thereof; 

cumulating the absolute values of the differ- 
ence values between the right contour pixels of 
the block of the current picture and the right 35 
contour pixels of the block of the reference pic- 
ture in a vertical scanning direction so as to 
obtain the sum thereof; and 
cumulating the absolute values of the differ- 
ence values between the lower contour pixels 40 
of the block of the current picture and the lower 
contour pixels of the block of the reference pic- 
ture in a horizontal scanning direction so as to 
obtain the sum thereof. 
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Fig. 6 
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Fig. 7 
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Fig. 11 
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